未分类 – 第 5 页 – HYL Studio

0.背景

因json文件、mysql、mongo存储都不能方便的满足我的要求，计划后续使用图数据库来存储复杂的的图状关系

1.安装

看了一眼dockerhub有现成的镜像，直接选了最新的


docker run -d \
    --publish=7474:7474 --publish=7687:7687 \
    --volume=/data/neo4j/data:/data \
    neo4j:5.5.0-community

docker run -d \

--publish=7474:7474 --publish=7687:7687 \

--volume=/data/neo4j/data:/data \

neo4j:5.5.0-community

7474是web端浏览器的端口，7687是数据库本身的端口。启动后默认用户名密码都是neo4j，记得修改密码。这里测试，因此用弱密码12345678

2.使用

2.1.基本语法

node节点


()                  //匿名的节点，不包含标签和变量，可以代表数据库的任意节点
(p:Person)          //使用变量p和标签Person
(:Technology)       //没有变量，标签Technology
(work:Company)      //使用变量work和标签Company

() //匿名的节点，不包含标签和变量，可以代表数据库的任意节点

(p:Person) //使用变量p和标签Person

(:Technology) //没有变量，标签Technology

(work:Company) //使用变量work和标签Company

relationship关系


//按这个方向存储数据
CREATE (p:Person)-[:LIKES]->(t:Technology)

//反向查询关系不会返回任何结果
MATCH (p:Person)<-[:LIKES]-(t:Technology)

//如果不确定方向，可以不执行关系的方向来查询
MATCH (p:Person)-[:LIKES]-(t:Technology)

//关系也可以用变量
-[rel]->
-[rel:LIKES]->

//按这个方向存储数据

CREATE (p:Person)-[:LIKES]->(t:Technology)

//反向查询关系不会返回任何结果

MATCH (p:Person)<-[:LIKES]-(t:Technology)

//如果不确定方向，可以不执行关系的方向来查询

MATCH (p:Person)-[:LIKES]-(t:Technology)

//关系也可以用变量

-[rel]->

-[rel:LIKES]->

properties属性


Node的属性(p:Person {name: 'Sally'})

Relationship的属性: -[rel:IS_FRIENDS_WITH {since: 2018}]->

Node的属性(p:Person {name: 'Sally'})

Relationship的属性: -[rel:IS_FRIENDS_WITH {since: 2018}]->

好了，你已经学会基本的语法了，是时候设计一个复杂的项目了（

3.集成到java中

尝试 spring-boot 3 + neo4j ORM

3.1.修改pom.xml


        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-data-neo4j</artifactId>
        </dependency>

<groupId>org.springframework.boot</groupId>

<artifactId>spring-boot-starter-data-neo4j</artifactId>

</dependency>

3.2.entity类


import lombok.Data;
import org.springframework.data.annotation.CreatedDate;
import org.springframework.data.annotation.LastModifiedDate;
import org.springframework.data.neo4j.core.schema.*;
import org.springframework.data.neo4j.core.schema.Relationship.Direction;
import org.springframework.data.neo4j.core.support.UUIDStringGenerator;

import java.util.ArrayList;
import java.util.List;

@Data
@Node("LabelName")
public class SomeNodeEntity {

    @Id
    @GeneratedValue(generatorClass = UUIDStringGenerator.class)
    private String id;
    @Property("title")
    private String title;
    @Property("description")
    private String description;
    @CreatedDate //need @EnableNeo4jAuditing
    private Long createdAt;
    @LastModifiedDate //need @EnableNeo4jAuditing
    private Long updatedAt;
    @Relationship(type = "DIRECTED", direction = Direction.INCOMING)
    private List<OtherNodeEntity> directors = new ArrayList<>();

}

import lombok.Data;

import org.springframework.data.annotation.CreatedDate;

import org.springframework.data.annotation.LastModifiedDate;

import org.springframework.data.neo4j.core.schema.*;

import org.springframework.data.neo4j.core.schema.Relationship.Direction;

import org.springframework.data.neo4j.core.support.UUIDStringGenerator;

import java.util.ArrayList;

import java.util.List;

@Data

@Node("LabelName")

public class SomeNodeEntity {

@Id

@GeneratedValue(generatorClass = UUIDStringGenerator.class)

private String id;

@Property("title")

private String title;

@Property("description")

private String description;

@CreatedDate //need @EnableNeo4jAuditing

private Long createdAt;

@LastModifiedDate //need @EnableNeo4jAuditing

private Long updatedAt;

@Relationship(type = "DIRECTED", direction = Direction.INCOMING)

private List<OtherNodeEntity> directors = new ArrayList<>();

}

3.3 repo类


package cn.hylstudio.skykoma.data.collector.repo.neo4j;

import cn.hylstudio.skykoma.data.collector.entity.neo4j.MovieEntity;
import org.springframework.data.neo4j.repository.Neo4jRepository;

public interface MovieEntityRepo extends Neo4jRepository<MovieEntity, String> {
    MovieEntity findByTitle(String title);
}

package cn.hylstudio.skykoma.data.collector.repo.neo4j;

import cn.hylstudio.skykoma.data.collector.entity.neo4j.MovieEntity;

import org.springframework.data.neo4j.repository.Neo4jRepository;

public interface MovieEntityRepo extends Neo4jRepository<MovieEntity, String> {

MovieEntity findByTitle(String title);

}

注意：关系字段中，如果实体不存在则会自动创建Node，但如果修改实体导致数据减少，OGM不会删除关联的实体，只会删除关系

参考

https://docs.spring.io/spring-data/neo4j/docs/current/reference/html/#preface

https://neo4j.com/docs/getting-started/current/get-started-with-neo4j/

https://neo4j.com/docs/browser-manual/current/

https://www.w3cschool.cn/neo4j/neo4j_cql_introduction.html

背景

开发的插件点击后UI卡住，怀疑是阻塞了UI线程。。。。仔细看下文档

文档翻译-Action的实现

自定义的action类是派生自抽象类 AnAction的子类。当用户操作菜单项或工具栏按钮时，IDEA会调用action的方法

基于 AnAction 的类不能包含任何属性，因为 AnAction 的实例会存在 application整个生命周期。如果 AnAction 类使用了属性存储了短声明周期的数据但没有合理的清除，会造成内存泄漏。例如如果你把Project对象存到了这里，当用户关闭了这个Project之后就会发生内存泄漏

方法Override覆盖原则

每个action可以覆盖 AnAction.update()，必须覆盖AnAction.actionPerformed().

AnAction.update() 用来被IDEA调用更新action的状态，action是否可用/是否可见取决于action在当前UI上是否可用.AnActionEvent 对象会传递给这个方法并且包含当前action上下文的信息。可以通过修改和事件上下文关联的Presentation对象状态来改变action是否可用。像Overriding the AnAction.update() Method说的一样， update() 方法的执行速度非常重要

2022.3+版本后AnAction.getActionUpdateThread() 返回 ActionUpdateThread 线程决定了 update() 方法是否在 background thread (BGT) or the event-dispatching thread (EDT)上被调用。首选的方式是在BGT上执行update方法, 这样可以保证application侧读取 PSI, the virtual file system (VFS), 或 project models的有利条件。在BGT上运行update的Actions不应该直接访问Swing 组件的结构。反之EDT上运行的update的Action必须禁止访问PSI, VFS, 或 project的数据，但可以访问Swing组件和其他UI模型。所有由DataContext 提供的可访问数据在这里有说明 Determining the Action Context. 当必须从BGT切换回EDT时，需要使用 AnActionEvent.getUpdateSession()方法获得 UpdateSession 并调用 UpdateSession.compute() 在EDT上运行方法。从2022.3开始，插件的DevKit将会有检查 Plugin DevKit | Code | ActionUpdateThread 是否丢失，来提醒插件作者实现这个方法

AnAction.actionPerformed() 将会在可用之后当用户选择action时被IDEA调用。这个方法是实现action最麻烦的任务，它包含了当action被调用时要执行的代码。 actionPerformed()方法也接收一个 AnActionEvent作为参数，它用来访问任何上下文相关的信息例如 projects, files, selection。。。参考Overriding the AnAction.actionPerformed() Method 获取更多信息

这里还有其他的方法可以在 AnAction 类中被覆盖，例如改变action默认的 Presentation。还有一个使用场景可以通过覆盖构造器来达成，当动态注册到分组的时候demo可以在这里看到Grouping Actions

AnAction.update

IDEA会周期性的调用AnAction.update() 方法来响应用户的操作。 update() 方法用于动态判断action在当前上下文是否应该禁用或启用。方法的实现必须确保可用性状态和可见性状态，否则指定的action将会”卡住”。（译者注：这里的意思应该是从用户看来是卡住的现象，实际就是没响应任何动作）

AnAction.update()方法可能在UI线程上频繁的调用。所以这个方法必须非常快的执行，没有必须执行的实际动作。例如检查选中的对象是否可用，但不做任何文件系统相关的动作。如果新的状态无法被快速的确定是否可用，判定过程应该在AnAction.actionPerformed()中执行，并通知notify用户这个动作在当前上下文不能被执行

线程

//TODO

参考

https://plugins.jetbrains.com/docs/intellij/basic-action-system.html

https://plugins.jetbrains.com/docs/intellij/general-threading-rules.html#modality-and-invokelater

20230224dev-assistant idea plugin开发

既然ChatGPT能理解自然语言，为什么不让它来帮我写代码完成这个开发任务呢？

基于这个猜想，我尝试让它编写IDEA插件逻辑，以一个LOGGER插入为例。

我给的命令是

“

利用IntelliJ Platform Plugin SDK获取当前光标所在类的成员变量，检测是否存在LOGGER，如果不存在，在类声明的第一行插入LOGGER的声明，并import对应的slf4j依赖。用java实现

”

它给出的代码如下


import com.intellij.openapi.actionSystem.*;
import com.intellij.openapi.project.Project;
import com.intellij.psi.*;
import com.intellij.psi.search.GlobalSearchScope;
import com.intellij.psi.search.searches.ClassInheritorsSearch;
import com.intellij.psi.search.searches.ReferencesSearch;
import com.intellij.psi.util.PsiUtil;
import com.intellij.psi.util.PsiUtilCore;
import com.intellij.psi.util.PsiUtilCore;
import com.intellij.util.Query;
import org.jetbrains.annotations.NotNull;
import org.jetbrains.annotations.Nullable;

import java.util.List;
import java.util.Objects;

public class AddLoggerToClassAction extends AnAction {

    private static final String LOGGER_DECLARATION = "private static final org.slf4j.Logger LOGGER = org.slf4j.LoggerFactory.getLogger(%s.class);";

    private static final String SLF4J_IMPORT = "import org.slf4j.LoggerFactory;";

    @Override
    public void actionPerformed(@NotNull AnActionEvent e) {
        // 获取当前项目和光标所在元素
        PsiFile psiFile = e.getData(CommonDataKeys.PSI_FILE);
        Editor editor = e.getData(CommonDataKeys.EDITOR);
        Project project = e.getProject();

        if (psiFile == null || editor == null || project == null) {
            return;
        }

        // 获取当前光标所在元素
        PsiElement psiElement = psiFile.findElementAt(editor.getCaretModel().getOffset());
        PsiClass psiClass = PsiUtil.getTopLevelClass(psiElement);

        if (psiClass == null) {
            return;
        }

        // 检查类中是否已经存在 LOGGER
        if (hasLogger(psiClass)) {
            return;
        }

        // 插入 LOGGER 声明并 import slf4j 依赖
        PsiElementFactory elementFactory = JavaPsiFacade.getElementFactory(project);
        PsiImportList importList = psiFile.getImportList();

        if (importList != null && importList.findOnDemandImportStatement("org.slf4j") == null) {
            importList.add(elementFactory.createImportStatementOnDemand("org.slf4j"));
        }

        PsiField loggerField = elementFactory.createFieldFromText(String.format(LOGGER_DECLARATION, psiClass.getName()), psiClass);

        PsiElement firstElement = PsiUtilCore.findFirstNonWhitespaceElement(psiClass);
        psiClass.addBefore(loggerField, firstElement);
    }

    private static boolean hasLogger(PsiClass psiClass) {
        for (PsiField field : psiClass.getFields()) {
            if (Objects.equals(field.getType().getCanonicalText(), "org.slf4j.Logger") &&
                    Objects.equals(field.getName(), "LOGGER") &&
                    field.getModifierList().hasModifierProperty(PsiModifier.STATIC) &&
                    field.getModifierList().hasModifierProperty(PsiModifier.FINAL)) {
                return true;
            }
        }
        return false;
    }
}

import com.intellij.openapi.actionSystem.*;

import com.intellij.openapi.project.Project;

import com.intellij.psi.*;

import com.intellij.psi.search.GlobalSearchScope;

import com.intellij.psi.search.searches.ClassInheritorsSearch;

import com.intellij.psi.search.searches.ReferencesSearch;

import com.intellij.psi.util.PsiUtil;

import com.intellij.psi.util.PsiUtilCore;

import com.intellij.util.Query;

import org.jetbrains.annotations.NotNull;

import org.jetbrains.annotations.Nullable;

import java.util.List;

import java.util.Objects;

public class AddLoggerToClassAction extends AnAction {

private static final String LOGGER_DECLARATION = "private static final org.slf4j.Logger LOGGER = org.slf4j.LoggerFactory.getLogger(%s.class);";

private static final String SLF4J_IMPORT = "import org.slf4j.LoggerFactory;";

@Override

public void actionPerformed(@NotNull AnActionEvent e) {

// 获取当前项目和光标所在元素

PsiFile psiFile = e.getData(CommonDataKeys.PSI_FILE);

Editor editor = e.getData(CommonDataKeys.EDITOR);

Project project = e.getProject();

if (psiFile == null || editor == null || project == null) {

return;

}

// 获取当前光标所在元素

PsiElement psiElement = psiFile.findElementAt(editor.getCaretModel().getOffset());

PsiClass psiClass = PsiUtil.getTopLevelClass(psiElement);

if (psiClass == null) {

return;

}

// 检查类中是否已经存在 LOGGER

if (hasLogger(psiClass)) {

return;

}

// 插入 LOGGER 声明并 import slf4j 依赖

PsiElementFactory elementFactory = JavaPsiFacade.getElementFactory(project);

PsiImportList importList = psiFile.getImportList();

if (importList != null && importList.findOnDemandImportStatement("org.slf4j") == null) {

importList.add(elementFactory.createImportStatementOnDemand("org.slf4j"));

}

PsiField loggerField = elementFactory.createFieldFromText(String.format(LOGGER_DECLARATION, psiClass.getName()), psiClass);

PsiElement firstElement = PsiUtilCore.findFirstNonWhitespaceElement(psiClass);

psiClass.addBefore(loggerField, firstElement);

}

private static boolean hasLogger(PsiClass psiClass) {

for (PsiField field : psiClass.getFields()) {

if (Objects.equals(field.getType().getCanonicalText(), "org.slf4j.Logger") &&

Objects.equals(field.getName(), "LOGGER") &&

field.getModifierList().hasModifierProperty(PsiModifier.STATIC) &&

field.getModifierList().hasModifierProperty(PsiModifier.FINAL)) {

return true;

}

return false;

}

对不起，是我高估了AI的实力，它部分代码在胡写。。。。得自己验证是否可行，它的代码看着没毛病，但实际很多地方都有问题= =

还是自己动手写吧，参考 https://www.bilibili.com/video/BV15D4y137Sp/

20230218长期计划：dev-assistant

背景

最近试用ChatGPT给我带来了新的想法，如果你觉得我后面写的比较离谱，那确实有可能是我错误的高估了现有AI的能力，就当我是在做梦吧hhhh。总的来说这种对话的方式极大的降低了人机交互的门槛。相比于传统的交互方式，以自然语言和计算机进行有效的交互是听上去理所当然，但实际上一直都不太成熟的方式。而ChatGPT给我们带来了新的希望，我认为之后这个技术足够成熟之后将会改变很多现有的交互逻辑。可以设想，假如以后AI能正确理解绝大部分的自然语言，那么是不是很多任务都不需要用鼠标和键盘来操作了？而根据网友给出的参考资料，有人正在尝试将自然语言转化为一系列的API调用（参考最后的附录），这意味着AI生成的内容将具有可执行的特性，不同的API完全可以代替现有的人工操作，完成一场人机交互的变革。

继上一次我根据AST上下文来做可控的LiveTemplate之后，我继续尝试了提取代码的AST节点并结构化其中的语义信息配合可视化来提高日常工作效率。但短期内无论从安全角度还是对成果负责的角度来说，程序生成的结果，或者说AI的动作都必须经过人工的确认以避免AI失控造成不好的后果。也就是说在相当长的一段时间内，AI的操作必须要可观测、可干预。以此为前提让我有了一个科幻的想法：我对电脑用自然语言下达任务后，电脑在我的监视下逐步完成任务。选择离我最近的场景来说就是日常的编码工作在有详细设计的情况下是否有希望完全自动化？

可行性分析

现有的代码生成AI大多是基于工程内已有的文件、注释、当前文件光标的上下文来猜测并生成代码，但这里面缺少了一个重要的信息就是目的。AI无法准确猜测人的意图，比如完成某个API的编码通常会分成接入层、业务层、数据层，多层次+多个方法的组合。AI每次只能预测我选定光标位置的代码内容，而无法连续跳跃多个层次来完成这个任务，依然需要人工大量操作IDE。如果能以自然语言提供给AI这个目的，是否有可能让AI自行完成这一系列的动作呢？由此会带来的一系列问题。开发人员对IDE的操作是否能通过文本精确的描述？开发人员操作IDE时依赖的信息有没有可能被收集起来并打上标记？如果将我日常操作IDE的记录和操作IDE时候的信息完整的记录下来并打上标记，能否训练出一个AI来理解并代替我进行IDE的操作？

以我目前的AI水平还停留在手写数字识别的入门级别，虽然有计划学习相关知识，不过并不是抱很大的希望能独立搞定模型的设计、训练之类如此专业的任务。但以我目前的能力，处理点数据、集成已有的功能还是不成什么问题的。因此我有一个长期计划的想法，设计并收集开发操作IDE的上下文信息，包括但不限于工程类型、文件组织结构、版本控制信息、产物信息、光标上下文信息等。依赖这些详细的信息，自动或手动的分析任务场景打上标记作为下一步AI训练的基础数据。抽取并实现一组API来获取、操作IDE内的动作并实时的反馈到屏幕上供人工干预这个过程。至于这个AI怎么训练，那可以将这个项目开源交给AI的专业人士搞定，我可以力所能及的收集数据或组合已有功能。退一步来说，就算AI搞不出来，收集的这些信息可以继续试用传统方式来处理，也能推动现一点点xxxAsCode的进程。

方案设计

项目名代号暂定为skykoma，分别取自skynet和tachikoma的一半，如果有好的名字欢迎反馈给我。整个项目拆分成若干模块分别独立实现，如果有生之年每个部分最后都能完全实现，则组合到一起。

信息收集模块：收集当前工程结构、版本控制、产物、光标上下文、IDE等信息，这些信息等价于开发员看到和了解到的信息。收集开发人员对IDE的操作序列数据。

信息处理模块：对收集到的信息做预处理，标记子序列对应的场景并用自然语言描述，在必要的位置插入人工干预的节点，以此作为训练的基础数据。

指令生成模块：接受自然语言描述的任务，生成一系列结构化指令

指令调度模块：接收一系列结构化指令并转化成具体的动作，动作的序列必须满足人工可观测、可干预、可理解，符合正常人操作的习惯，且动作序列有对应的API。理论上训练数据如果足够好可以达到部分效果，但为了可控和安全还是需要一个调度模块，为的是有机会通过程序强制干预AI的结果，加一道保险。

动作执行模块：给定具体动作并执行的同时收集结果、可视化反馈

以一个常见的场景为例：

自然语言描述：查找ClassA的所有实现类。

指令生成模块：打开搜索功能，输入关键字ClassA，从结果中定位ClassA，打开ClassA对应的文件编辑器，光标定位到ClassA的声明位置，搜索实现类(Ctrl+Alt+B)

指令调度模块插入必要指令：打开搜索功能，输入关键字ClassA，从结果中定位ClassA，判断是否能定位到ClassA（满足人工干预的要求），尝试打开ClassA对应的文件编辑器，光标定位到ClassA的声明位置，搜索实现类(Ctrl+Alt+B)，收集搜索结果同时展示到屏幕上（满足可观测的要求）

指令调度模块转化指令到具体的API：打开搜索功能，输入关键字ClassA，从结果中定位ClassA，判断是否能定位到ClassA（满足人工干预的要求），尝试打开ClassA对应的文件编辑器，搜索当前文件下所有的class声明（指令调度需要生成API可支持的操作），寻找ClassA的声明位置（指令调度需要生成API可支持的操作），搜索实现类(Ctrl+Alt+B)，收集搜索结果同时展示到屏幕上（满足可观测的要求）

执行模块：依赖指定调度的API结果控制IDE依次执行对应的指令

以下的ChatGPT给出的示例代码


import com.intellij.openapi.actionSystem.AnAction;
import com.intellij.openapi.actionSystem.AnActionEvent;
import com.intellij.openapi.project.Project;
import com.intellij.openapi.util.text.StringUtil;
import com.intellij.psi.*;
import org.jetbrains.annotations.NotNull;

import java.util.ArrayList;
import java.util.List;

public class FindClassImplementationsAction extends AnAction {

    @Override
    public void actionPerformed(@NotNull AnActionEvent e) {
        // 获取当前项目
        Project project = e.getProject();
        if (project == null) {
            return;
        }

        // 获取当前光标所在的类
        PsiElement psiElement = e.getData(CommonDataKeys.PSI_ELEMENT);
        if (psiElement instanceof PsiClass) {
            PsiClass psiClass = (PsiClass) psiElement;

            // 查找所有实现该类的子类
            List<PsiClass> implementations = getImplementations(psiClass);

            // 输出结果
            StringBuilder sb = new StringBuilder();
            sb.append("Implementations of ").append(psiClass.getName()).append(":\n\n");
            for (PsiClass implementation : implementations) {
                sb.append(implementation.getQualifiedName()).append("\n");
            }
            System.out.println(sb.toString());
        }
    }

    private List<PsiClass> getImplementations(PsiClass psiClass) {
        List<PsiClass> implementations = new ArrayList<>();
        Project project = psiClass.getProject();
        GlobalSearchScope scope = GlobalSearchScope.projectScope(project);
        String classQualifiedName = psiClass.getQualifiedName();

        // 查找实现该类或者接口的所有类
        Query<PsiClass> query = ClassInheritorsSearch.search(psiClass, scope, true);
        for (PsiClass result : query) {
            if (result != null && StringUtil.isNotEmpty(result.getQualifiedName())) {
                if (!result.getQualifiedName().equals(classQualifiedName)) {
                    implementations.add(result);
                }
            }
        }
        return implementations;
    }
}

import com.intellij.openapi.actionSystem.AnAction;

import com.intellij.openapi.actionSystem.AnActionEvent;

import com.intellij.openapi.project.Project;

import com.intellij.openapi.util.text.StringUtil;

import com.intellij.psi.*;

import org.jetbrains.annotations.NotNull;

import java.util.ArrayList;

import java.util.List;

public class FindClassImplementationsAction extends AnAction {

@Override

public void actionPerformed(@NotNull AnActionEvent e) {

// 获取当前项目

Project project = e.getProject();

if (project == null) {

return;

}

// 获取当前光标所在的类

PsiElement psiElement = e.getData(CommonDataKeys.PSI_ELEMENT);

if (psiElement instanceof PsiClass) {

PsiClass psiClass = (PsiClass) psiElement;

// 查找所有实现该类的子类

List<PsiClass> implementations = getImplementations(psiClass);

// 输出结果

StringBuilder sb = new StringBuilder();

sb.append("Implementations of ").append(psiClass.getName()).append(":\n\n");

for (PsiClass implementation : implementations) {

sb.append(implementation.getQualifiedName()).append("\n");

}

System.out.println(sb.toString());

}

private List<PsiClass> getImplementations(PsiClass psiClass) {

List<PsiClass> implementations = new ArrayList<>();

Project project = psiClass.getProject();

GlobalSearchScope scope = GlobalSearchScope.projectScope(project);

String classQualifiedName = psiClass.getQualifiedName();

// 查找实现该类或者接口的所有类

Query<PsiClass> query = ClassInheritorsSearch.search(psiClass, scope, true);

for (PsiClass result : query) {

if (result != null && StringUtil.isNotEmpty(result.getQualifiedName())) {

if (!result.getQualifiedName().equals(classQualifiedName)) {

implementations.add(result);

}

return implementations;

}

概要设计

以上模块将会划分成多个开源项目，为了便于实现部分逻辑上的模块会放到同一个实际的项目中

交互层 skykoma-plugin-idea(1), skykoma-plugin-vscode(2), skykoma-chatbot(3) , skykoma-agent(待定), skykoma-workspace(待定) 顾名思义交互层定位于用户的输入和输出，同一管理最外层的交互

数据层 skykoma-data-collector(4), skykoma-data-handler(5), 收集和处理所有相关的数据并存储、上报

逻辑层 skykoma-core(6), skykoma-cmd-generator(7), skykoma-api-transformer(8), skykoma-api-worker(9), core就是核心的模型负责自然语言处理并生成第一版指令序列，cmd-generator负责指令的调度、插值、过滤以符合前文所说的各种条件，api-transformer负责把指令序列做翻译成现存工具的API调用, worker负责调用具体的API

执行层 skykoma-api: skykoma-api-idea,skykoma-api-vscode,skykoma-api-git(10),skykoma-api-mvn(11),skykoma-api-gitlab(12),skykoma-api-github(13), 顾名思义，实现整合各个现有工具的功能，以localhost HTTP、cmdline、rpc等方式对外提供服务

里程碑规划

v0.1 搭框架

手动完成realworld或者其他什么的工程编写作为测试项目，要求满足常见的企业级开发特性。

初始化idea插件工程（https://github.com/dev-assistant/skykoma-plugin-idea），支持私有化部署，收集idea当前的项目信息。

初始化数据收集工程（https://github.com/dev-assistant/skykoma-data-collector），支持私有化部署，数据存储位置可自行选择。

skykoma-plugin-idea概要设计

架构上因为不想出现多个idea插件，因此设计一个skykoma-api-idea负责和idea的api具体交互，kykoma-plugin-idea依赖skykoma-api-idea来获得对IDE完整的感知和控制能力。plugin支持常用的LiveTemplate，设计生成规则，在固定场景下支持人工触发生成。skykoma-api-idea收集idea的状态和操作事件并上报给skykoma-data-collector达成数据收集目的。同时也可以通过websocket、http等协议监听本地端口或从外部的控制模块获取指令。

模板代码自动生成功能

模板代码生成主要依赖于LiveTemplate实现，分为静态生成和动态生成，静态生成是上下文无关的，动态生成可感知代码上下文。

静态生成

如@Autowire @Column 之类的，试用idea自带API完成命名风格的转换。

动态生成

日志：寻找上下文中可用的LOGGER，若LOGGER不存在则尝试先生成LOGGER字段，并根据当前上下文插入LOGGER语句。

SQL：寻找上下文中的ORM注解信息，根据字段类型生成默认的建表语句。

数据复制：根据上下文获取指定类的所有属性，复制到当前上下文中或指定的对象中，代替动态的反射copy避免运行时异常。

Service：增强自带的创建类过程，根据类名猜测正确的包名，一键生成带注解的Service类和接口并实现对应接口满足主流项目的风格要求，减少人工操作。

代码见 https://github.com/dev-assistant/skykoma-plugin-idea

数据上报功能

TODO 设计数据结构表示上下文，包括当前窗口信息、窗口标题、项目信息、git信息、全量AST信息等

代码见 https://github.com/dev-assistant/skykoma-data-collector

skykoma-data-collector概要设计

负责skykoma需要的数据收集工作，用多种合适的存储方案持久化用户每个操作的上下文信息和事件。语义图暂定neo4j图数据库，其他结构化信息继续使用mysql。

设计数据结构存储相关信息

有了全量AST和语义，才有可能做到
1.给定任意项目任意API、自动提取可运行的最小依赖沙盒环境
2.任意复杂业务逻辑分析，不重不漏
3.沙盒环境的修改可回填到原始项目：可debug、做测试用例、分析逻辑、修改
4.因沙河内依赖最小化了，理论上可以用自然语言总结所有的上下文和代码意图信息、为炼丹做准备。退一步即使炼丹失败，也能快速抽象出大量模板代码来使用
5.反向给定自然语言生成沙盒环境、可完成对任意项目的patch


1.ProjectEntity
(project:ProjectEntity {
    key:key//项目key
    name:name//项目名称
})
id	1 项目id
key:key//项目key
name:name//项目名称
name realworld  项目名称

CREATE INDEX idx_project_key IF NOT EXISTS FOR (m:ProjectEntity) ON (m.key) ;
2.ScanRecordEntity
(scanRecord:ScanRecordEntity){
    scanId:scanId//扫描id
}
CREATE INDEX idx_scan_record_scanId IF NOT EXISTS FOR (m:ScanRecordEntity) ON (m.scanId) ;
//扫描信息所属关系 1:n
(:ProjectEntity)-[:HAS_SCAN_RECORD]->(:ScanRecordEntity)

3.VCSEntity
(vcsEntity:VCSEntity{
    name:name,//仓库名称
    path:path,//仓库本地绝对路径
    vcsType:vcsType//仓库类型 git
})
VCSEntity
id	7aaf76a6-385a-480e-9377-335d798bb516
name	realworld-mdd
path	D:\code\realworld-mdd
vcsType	git
createdAt	1678551239850
updatedAt	1678551239850
//版本控制信息关系 1:1
(:ProjectEntity)-[:VCS_BY]->(:VCSEntity)

4.ModuleEntity
(module:ModuleEntity {
    name:name//模块名称
})
ModuleEntity
id	8a078585-5c06-43be-93b0-dd551244c64c
name root 模块名称
createdAt	1678551238729
updatedAt	1678551239249

//模块包含关系 1:n
(:ScanRecordEntity)-[:CONTAINS]->(:ModuleEntity)

5.FileEntity
(file:FileEntity{
    name:name,//文件名
    type:type,//文件类型 file/folder
    relativePath:relativePath//相对路径
})
FileEntity
id	d9cbe0a4-3f60-4704-a419-7489ee530fc8  文件id
name	user 
type	folder 文件类型 file/folder
relativePath	src-gen\main\java\cn\hylstudio\mdse\demo\realworld\model\response\user 相对路径
createdAt	1678551233924 
updatedAt	1678551239353
CREATE INDEX idx_file_id IF NOT EXISTS FOR (m:FileEntity) ON (m.id) ;
CREATE INDEX idx_file_relativePath IF NOT EXISTS FOR (m:FileEntity) ON (m.relativePath) ;
//符号连接关系 n:1
(:FileEntity)-[:SYMBOL_LINK]->(:FileEntity)
//项目根目录 1:1
(:ScanRecordEntity)-[:ROOT_AT]->(:FileEntity)
//模块根目录 1:n
(:ModuleEntity)-[:MODULE_ROOT{
    type: type//src testSrc resources testResources
}]->(:FileEntity)

6.PsiElementEntity
(:PsiElementEntity{//语法树
    className：className//psiElement实现类
    startOffset	//文本开始位置
    endOffset//文本结束位置
    originText//原始文本
})
PsiElementEntity
id	f30db139-4a90-4c10-b740-ac85514ab787
className	com.intellij.psi.impl.source.PsiImportListImpl
startOffset	59
endOffset	857
originText	'java code'
createdAt	1680274076903
updatedAt	1680274076903

6.1.类
com.intellij.psi.impl.source.PsiClassImpl
$.qualifiedName str //全限定类名 com.a.b.c.ClassA

6.2.注解
com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl
$.qualifiedName str //全限定类名 com.a.b.c.AnnotationA
$.attributes arr //属性数组
$.attributes[i] obj
$.attributes[i].name str //属性名
$.attributes[i].values arr //属性值
$.attributes[i].values[i] str //属性值

//文件包含语法树根节点 1:n
(:FileEntity)-[:HAS_PSI_ELEMENTS]->(:PsiElementEntity)
//语法树包含关系 1:n
(:PsiElementEntity)-[:CONTAINS]->(:PsiElementEntity)

7.AnnotationAttrEntity
(:AnnotationAttrEntity{//注解属性
    name
    values
})

CREATE INDEX idx_psi_element_id IF NOT EXISTS FOR (m:PsiElementEntity) ON (m.id) ;
CREATE INDEX idx_psi_className IF NOT EXISTS FOR (m:PsiElementEntity) ON (m.className) ;
CREATE INDEX idx_psi_qualifiedName IF NOT EXISTS FOR (m:PsiElementEntity) ON (m.qualifiedName) ;
//注解关系 1:n
(:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiClassImpl'})-[:HAS_ANNOTATION]->(:PsiElementEntity{className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl'})
(:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiMethodImpl'})-[:HAS_ANNOTATION]->(:PsiElementEntity{className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl'})
//注解和注解属性的关系1:n
(:PsiElementEntity{className:"com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl"})-[:HAS_ATTR]->(:AnnotationAttrEntity)

8.ApiEndpointEntity
(:ApiEndpointEntity{
    scanId: scanId,
    method: httpMethod//RequestMethod.GET POST ....
    path: "/1/2/3" // /api/public/1/2/3
})

CREATE INDEX idx_api_endpoint_scanId IF NOT EXISTS FOR (m:ApiEndpointEntity) ON (m.scanId) ;
CREATE INDEX idx_api_endpoint_path IF NOT EXISTS FOR (m:ApiEndpointEntity) ON (m.path) ;
//api入口绑定关系 1:n
(method:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiMethodImpl'})
-[:HAS_ANNOTATION]->
(methodAnnotation:PsiElementEntity{
    className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl',
    qualifiedName: 'org.springframework.web.bind.annotation.RequestMapping'
})
(method:PsiElementEntity)-[:HAS_ENDPOINT]->(:ApiEndPointEntity)


//查看IDEA日志
Get-Content  .\build\idea-sandbox\system\log\idea.log -Tail 100 -Wait

//列出所有项目
MATCH (project:ProjectEntity)
RETURN project.key

//列出指定项目下的扫描记录
MATCH (project:ProjectEntity)-[:HAS_SCAN_RECORD]->(scanRecord:ScanRecordEntity)
WHERE project.key = "realworld-mdd"
RETURN scanRecord.scanId, scanRecord.createdAt
ORDER BY scanRecord.createdAt DESC

//查看某次扫描记录
MATCH (project:ProjectEntity)
-[:HAS_SCAN_RECORD]->
(scanRecord:ScanRecordEntity)
-[*]-
(related)
WHERE 
scanRecord.scanId = "643e424c1b99436f82551420981669db"
RETURN project, scanRecord, related

// 查找要连接ModuleRoot的FileEntity和FileEntity
MATCH (scanRecord:ScanRecordEntity)-[rr:CONTAINS]->(module:ModuleEntity)-[rrr:MODULE_ROOT]->(moduleRoot:FileEntity)
MATCH (scanRecord)-[:ROOT_AT]->(:FileEntity)-[:CONTAINS*1..]->(srcRoot:FileEntity)
WHERE 
scanRecord.scanId = "643e424c1b99436f82551420981669db" AND
moduleRoot.relativePath = srcRoot.relativePath AND
moduleRoot <> srcRoot
RETURN scanRecord, rr, module, rrr, moduleRoot, srcRoot

// 连接ModuleRoot的FileEntity和FileEntity
MATCH (scanRecord:ScanRecordEntity)-[rr:CONTAINS]->(module:ModuleEntity)-[rrr:MODULE_ROOT]->(moduleRoot:FileEntity)
MATCH (scanRecord)-[:ROOT_AT]->(:FileEntity)-[:CONTAINS*1..]->(srcRoot:FileEntity)
WHERE 
scanRecord.scanId = "643e424c1b99436f82551420981669db" AND
moduleRoot.relativePath = srcRoot.relativePath AND
moduleRoot <> srcRoot
MERGE (moduleRoot)-[rrrr:SYMBOL_LINK]->(srcRoot)
RETURN scanRecord, rr, module, rrr, moduleRoot, rrrr, srcRoot

// 断开连接ModuleRoot的FileEntity和FileEntity
MATCH (scanRecord:ScanRecordEntity)-[rr:CONTAINS]->(module:ModuleEntity)-[rrr:MODULE_ROOT]->(moduleRoot:FileEntity)
MATCH (scanRecord)-[:ROOT_AT]->(:FileEntity)-[:CONTAINS*1..]->(srcRoot:FileEntity)
MATCH (moduleRoot)-[link:SYMBOL_LINK]->(srcRoot:FileEntity)
WHERE 
scanRecord.scanId = "643e424c1b99436f82551420981669db" AND
moduleRoot.relativePath = srcRoot.relativePath AND
moduleRoot <> srcRoot
DELETE link
RETURN scanRecord, rr, module, rrr, moduleRoot, srcRoot

// -[:TYPE*minHops..maxHops]->
//使用这个连接查询后面的文件树
MATCH (project:ProjectEntity)
-[:HAS_SCAN_RECORD]->(scanRecord:ScanRecordEntity)
-[:CONTAINS]->(module:ModuleEntity)
-[:MODULE_ROOT]->(moduleRoot:FileEntity)
-[:SYMBOL_LINK]->(srcRoot:FileEntity)
-[:CONTAINS*1..]->(files)
WHERE 
scanRecord.scanId = "643e424c1b99436f82551420981669db" 
RETURN project, scanRecord, module, moduleRoot, srcRoot, files

//查找指定扫描记录里的单个文件
MATCH
(scanRecord:ScanRecordEntity)-[:ROOT_AT|CONTAINS*1..]->(file:FileEntity)
WHERE
scanRecord.scanId = "643e424c1b99436f82551420981669db"
AND
file.relativePath = "src\\main\\java\\cn\\hylstudio\\mdse\\demo\\realworld\\controller\\user\\UserController.java"
RETURN file

//查看指定文件的语法树
MATCH
(scanRecord:ScanRecordEntity)-[:ROOT_AT|CONTAINS*1..]->(file:FileEntity)
-[:HAS_PSI_ELEMENTS|CONTAINS*1..]->(elements:PsiElementEntity)
WHERE
scanRecord.scanId = "643e424c1b99436f82551420981669db"
AND
file.relativePath = "src\\main\\java\\cn\\hylstudio\\mdse\\demo\\realworld\\controller\\user\\UserController.java"
RETURN file,elements
//获取当前文件所有的语法树节点类型
// RETURN  distinct(psiElements.className)
"com.intellij.psi.impl.source.tree.java.PsiPackageStatementImpl"
"com.intellij.psi.impl.source.tree.java.PsiKeywordImpl"
"com.intellij.psi.impl.source.PsiJavaCodeReferenceElementImpl"
"com.intellij.psi.impl.source.tree.java.PsiJavaTokenImpl"
"com.intellij.psi.impl.source.tree.java.PsiReferenceParameterListImpl"
"com.intellij.psi.impl.source.tree.java.PsiIdentifierImpl"
"com.intellij.psi.impl.source.tree.PsiWhiteSpaceImpl"
"com.intellij.psi.impl.source.PsiImportListImpl"
"com.intellij.psi.impl.source.PsiImportStatementImpl"
"com.intellij.psi.impl.source.PsiClassImpl"
"com.intellij.psi.impl.source.PsiMethodImpl"
"com.intellij.psi.impl.source.PsiModifierListImpl"
"com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl"
"com.intellij.psi.impl.source.tree.java.PsiAnnotationParamListImpl"
"com.intellij.psi.impl.source.tree.java.PsiNameValuePairImpl"
"com.intellij.psi.impl.source.tree.java.PsiReferenceExpressionImpl"
"com.intellij.psi.impl.source.tree.java.PsiLiteralExpressionImpl"
"com.intellij.psi.impl.source.PsiTypeElementImpl"
"com.intellij.psi.impl.source.PsiParameterListImpl"
"com.intellij.psi.impl.source.PsiParameterImpl"
"com.intellij.psi.impl.source.tree.java.PsiCodeBlockImpl"
"com.intellij.psi.impl.source.tree.java.PsiReturnStatementImpl"
"com.intellij.psi.impl.source.tree.java.PsiMethodCallExpressionImpl"
"com.intellij.psi.impl.source.tree.java.PsiExpressionListImpl"
"com.intellij.psi.impl.source.tree.java.PsiExpressionStatementImpl"
"com.intellij.psi.impl.source.tree.java.PsiDeclarationStatementImpl"
"com.intellij.psi.impl.source.tree.java.PsiLocalVariableImpl"
"com.intellij.psi.impl.source.tree.java.PsiIfStatementImpl"
"com.intellij.psi.impl.source.tree.java.PsiBlockStatementImpl"
"com.intellij.psi.impl.source.tree.java.PsiBinaryExpressionImpl"
"com.intellij.psi.impl.source.tree.java.PsiTypeParameterListImpl"
"com.intellij.psi.impl.source.PsiReferenceListImpl"
"com.intellij.psi.impl.source.tree.PsiCommentImpl"
"com.intellij.psi.impl.source.tree.java.PsiPrefixExpressionImpl"
"com.intellij.psi.impl.source.tree.java.PsiSwitchStatementImpl"
"com.intellij.psi.impl.source.tree.java.PsiSwitchLabelStatementImpl"
"com.intellij.psi.impl.source.tree.java.PsiCaseLabelElementListImpl"
"com.intellij.psi.impl.source.tree.java.PsiNewExpressionImpl"
"com.intellij.psi.impl.source.PsiDiamondTypeElementImpl"
"com.intellij.psi.impl.source.tree.java.PsiForeachStatementImpl"
"com.intellij.psi.impl.source.tree.java.PsiClassObjectAccessExpressionImpl"
"com.intellij.psi.impl.source.PsiFieldImpl"
"com.intellij.psi.impl.source.tree.java.PsiArrayInitializerMemberValueImpl"
"com.intellij.psi.impl.source.javadoc.PsiDocCommentImpl"
"com.intellij.psi.impl.source.javadoc.PsiDocTokenImpl"

//获取一个文件中的类、类的注解、类中的方法、方法注解，不使用HAS_ANNOTATION
MATCH (scanRecord:ScanRecordEntity)-[:ROOT_AT|CONTAINS*1..]->(file:FileEntity)
WHERE 
scanRecord.scanId = "643e424c1b99436f82551420981669db"
AND
file.relativePath = "src\\main\\java\\cn\\hylstudio\\mdse\\demo\\realworld\\controller\\user\\UserController.java"
OPTIONAL MATCH (file)-[:HAS_PSI_ELEMENTS|CONTAINS*1..]->
//match class info
(class:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiClassImpl'})
OPTIONAL MATCH (class)-[:CONTAINS]->
(classModifierList:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiModifierListImpl'})
OPTIONAL MATCH (classModifierList)-[:CONTAINS]->
(classAnnotation:PsiElementEntity{className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl'})
OPTIONAL MATCH (classAnnotation)-[:HAS_ATTR]->
(classAnnotationAttr:AnnotationAttrEntity)
//match method info
OPTIONAL MATCH (class)-[:CONTAINS]->
(method:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiMethodImpl'})
OPTIONAL MATCH (method)-[:CONTAINS]->
(mehotdModifierList:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiModifierListImpl'})
OPTIONAL MATCH (mehotdModifierList)-[:CONTAINS]->
(methodAnnotation:PsiElementEntity{className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl'})
OPTIONAL MATCH (methodAnnotation)-[:HAS_ATTR]->
(methodAnnotationAttr:AnnotationAttrEntity)
return 
class,classModifierList,classAnnotation,classAnnotationAttr,
method,mehotdModifierList,methodAnnotation,methodAnnotationAttr

//连接所有class和method上的注解
MATCH (scanRecord:ScanRecordEntity)-[:MODULE_ROOT|SYMBOL_LINK|CONTAINS*1..]->(file:FileEntity)
WHERE 
scanRecord.scanId = "643e424c1b99436f82551420981669db"
AND
file.type = "file"
MATCH (file)-[:HAS_PSI_ELEMENTS|CONTAINS*1..]->
//match class info
(class:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiClassImpl'})
MATCH (class)-[:CONTAINS]->
(classModifierList:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiModifierListImpl'})
MATCH (classModifierList)-[:CONTAINS]->
(classAnnotation:PsiElementEntity{className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl'})
MATCH (classAnnotation)-[:HAS_ATTR]->
(classAnnotationAttr:AnnotationAttrEntity)
//match method info
MATCH (class)-[:CONTAINS]->
(method:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiMethodImpl'})
MATCH (method)-[:CONTAINS]->
(methodModifierList:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiModifierListImpl'})
MATCH (methodModifierList)-[:CONTAINS]->
(methodAnnotation:PsiElementEntity{className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl'})
MATCH (methodAnnotation)-[:HAS_ATTR]->
(methodAnnotationAttr:AnnotationAttrEntity)
MERGE (class)-[:HAS_ANNOTATION]->(classAnnotation)
MERGE (method)-[:HAS_ANNOTATION]->(methodAnnotation)

//获取一个文件中的类、类的注解、类中的方法、方法注解，使用HAS_ANNOTATION
MATCH (scanRecord:ScanRecordEntity)-[:ROOT_AT|CONTAINS*1..]->(file:FileEntity)
WHERE 
scanRecord.scanId = "643e424c1b99436f82551420981669db"
AND
file.relativePath = "src\\main\\java\\cn\\hylstudio\\mdse\\demo\\realworld\\controller\\user\\UserController.java"
OPTIONAL MATCH (file)-[:HAS_PSI_ELEMENTS|CONTAINS*1..]->
//match class info
(class:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiClassImpl'})
OPTIONAL MATCH (class)-[:HAS_ANNOTATION]->
(classAnnotation:PsiElementEntity{className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl'})
OPTIONAL MATCH (classAnnotation)-[:HAS_ATTR]->
(classAnnotationAttr:AnnotationAttrEntity)
//match method info
OPTIONAL MATCH (class)-[:CONTAINS]->
(method:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiMethodImpl'})
OPTIONAL MATCH (method)-[:HAS_ANNOTATION]->
(methodAnnotation:PsiElementEntity{className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl'})
OPTIONAL MATCH (methodAnnotation)-[:HAS_ATTR]->
(methodAnnotationAttr:AnnotationAttrEntity)
return 
class,classAnnotation,classAnnotationAttr,
method,methodAnnotation,methodAnnotationAttr

//单个文件，根据注解查询Api入口，并关联到方法上
MATCH (scanRecord:ScanRecordEntity)-[:ROOT_AT|CONTAINS*1..]->(file:FileEntity)
WHERE 
scanRecord.scanId = "643e424c1b99436f82551420981669db"
AND
file.relativePath = "src\\main\\java\\cn\\hylstudio\\mdse\\demo\\realworld\\controller\\user\\UserController.java"
MATCH (file)-[:HAS_PSI_ELEMENTS|CONTAINS*1..]->
//match class info
(class:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiClassImpl'})
OPTIONAL MATCH (class)-[:HAS_ANNOTATION]->
(classAnnotation:PsiElementEntity{
    className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl',
    qualifiedName: 'org.springframework.web.bind.annotation.RequestMapping'
})
MATCH (classAnnotation)-[:HAS_ATTR]->
(classAnnotationAttr:AnnotationAttrEntity{name:"value"})
//match method info
MATCH (class)-[:CONTAINS]->
(method:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiMethodImpl'})
MATCH (method)-[:HAS_ANNOTATION]->
(methodAnnotation:PsiElementEntity{
    className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl',
    qualifiedName: 'org.springframework.web.bind.annotation.RequestMapping'
})
MATCH (methodAnnotation)-[:HAS_ATTR]->
(apiPathsOnMethod:AnnotationAttrEntity{name:"value"})
MATCH (methodAnnotation)-[:HAS_ATTR]->
(apiMethods:AnnotationAttrEntity{name:"method"})
UNWIND classAnnotationAttr.values AS prefix
UNWIND apiMethods.values AS httpMethod
UNWIND apiPathsOnMethod.values AS path
MERGE (method)-[:HAS_ENDPOINT]->(apiEndpoint:ApiEndpointEntity{method: httpMethod, path: prefix + path})
RETURN method, apiEndpoint

//全量文件，根据注解生成Api入口，并关联到方法和扫描记录上
MATCH (scanRecord:ScanRecordEntity)-[:MODULE_ROOT|SYMBOL_LINK|CONTAINS*1..]->(file:FileEntity)
WHERE 
scanRecord.scanId = "643e424c1b99436f82551420981669db"
AND
file.type = "file"
MATCH (file)-[:HAS_PSI_ELEMENTS|CONTAINS*1..]->
//match class info
(class:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiClassImpl'})
OPTIONAL MATCH (class)-[:HAS_ANNOTATION]->
(classAnnotation:PsiElementEntity{
    className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl',
    qualifiedName: 'org.springframework.web.bind.annotation.RequestMapping'
})
MATCH (classAnnotation)-[:HAS_ATTR]->
(classAnnotationAttr:AnnotationAttrEntity{name:"value"})
//match method info
MATCH (class)-[:CONTAINS]->
(method:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiMethodImpl'})
MATCH (method)-[:HAS_ANNOTATION]->
(methodAnnotation:PsiElementEntity{
    className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl',
    qualifiedName: 'org.springframework.web.bind.annotation.RequestMapping'
})
MATCH (methodAnnotation)-[:HAS_ATTR]->
(apiPathsOnMethod:AnnotationAttrEntity{name:"value"})
MATCH (methodAnnotation)-[:HAS_ATTR]->
(apiMethods:AnnotationAttrEntity{name:"method"})
UNWIND classAnnotationAttr.values AS prefix
UNWIND apiMethods.values AS httpMethod
UNWIND apiPathsOnMethod.values AS path
MERGE (apiEndpoint:ApiEndpointEntity {scanId: scanRecord.scanId, method: httpMethod, path: prefix + path})
MERGE (method)-[:HAS_ENDPOINT]->(apiEndpoint)
MERGE (scanRecord)-[:HAS_ENDPOINT]->(apiEndpoint)
RETURN method, apiEndpoint

//查找所有ApiEndpoint
MATCH (scanRecord:ScanRecordEntity)-[:HAS_ENDPOINT]->(apiEndpoint:ApiEndpointEntity)
WHERE 
scanRecord.scanId = "643e424c1b99436f82551420981669db"
RETURN apiEndpoint

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

141

142

143

144

145

146

147

148

149

150

151

152

153

154

155

156

157

158

159

160

161

162

163

164

165

166

167

168

169

170

171

172

173

174

175

176

177

178

179

180

181

182

183

184

185

186

187

188

189

190

191

192

193

194

195

196

197

198

199

200

201

202

203

204

205

206

207

208

209

210

211

212

213

214

215

216

217

218

219

220

221

222

223

224

225

226

227

228

229

230

231

232

233

234

235

236

237

238

239

240

241

242

243

244

245

246

247

248

249

250

251

252

253

254

255

256

257

258

259

260

261

262

263

264

265

266

267

268

269

270

271

272

273

274

275

276

277

278

279

280

281

282

283

284

285

286

287

288

289

290

291

292

293

294

295

296

297

298

299

300

301

302

303

304

305

306

307

308

309

310

311

312

313

314

315

316

317

318

319

320

321

322

323

324

325

326

327

328

329

330

331

332

333

334

335

336

337

338

339

340

341

342

343

344

345

346

347

348

349

350

351

352

353

354

355

356

357

358

359

360

361

362

363

364

365

366

367

368

369

370

371

372

373

374

375

376

377

378

379

380

381

382

383

384

385

386

387

388

389

390

391

392

393

394

395

396

397

398

399

400

401

402

403

404

405

406

407

408

409

410

411

412

413

414

415

416

417

418

419

420

421

422

423

424

425

1.ProjectEntity

(project:ProjectEntity {

key:key//项目key

name:name//项目名称

})

id 1 项目id

key:key//项目key

name:name//项目名称

name realworld 项目名称

CREATE INDEX idx_project_key IF NOT EXISTS FOR (m:ProjectEntity) ON (m.key) ;

2.ScanRecordEntity

(scanRecord:ScanRecordEntity){

scanId:scanId//扫描id

}

CREATE INDEX idx_scan_record_scanId IF NOT EXISTS FOR (m:ScanRecordEntity) ON (m.scanId) ;

//扫描信息所属关系 1:n

(:ProjectEntity)-[:HAS_SCAN_RECORD]->(:ScanRecordEntity)

3.VCSEntity

(vcsEntity:VCSEntity{

name:name,//仓库名称

path:path,//仓库本地绝对路径

vcsType:vcsType//仓库类型 git

})

VCSEntity

id 7aaf76a6-385a-480e-9377-335d798bb516

name realworld-mdd

path D:\code\realworld-mdd

vcsType git

createdAt 1678551239850

updatedAt 1678551239850

//版本控制信息关系 1:1

(:ProjectEntity)-[:VCS_BY]->(:VCSEntity)

4.ModuleEntity

(module:ModuleEntity {

name:name//模块名称

})

ModuleEntity

id 8a078585-5c06-43be-93b0-dd551244c64c

name root 模块名称

createdAt 1678551238729

updatedAt 1678551239249

//模块包含关系 1:n

(:ScanRecordEntity)-[:CONTAINS]->(:ModuleEntity)

5.FileEntity

(file:FileEntity{

name:name,//文件名

type:type,//文件类型 file/folder

relativePath:relativePath//相对路径

})

FileEntity

id d9cbe0a4-3f60-4704-a419-7489ee530fc8 文件id

name user

type folder 文件类型 file/folder

relativePath src-gen\main\java\cn\hylstudio\mdse\demo\realworld\model\response\user 相对路径

createdAt 1678551233924

updatedAt 1678551239353

CREATE INDEX idx_file_id IF NOT EXISTS FOR (m:FileEntity) ON (m.id) ;

CREATE INDEX idx_file_relativePath IF NOT EXISTS FOR (m:FileEntity) ON (m.relativePath) ;

//符号连接关系 n:1

(:FileEntity)-[:SYMBOL_LINK]->(:FileEntity)

//项目根目录 1:1

(:ScanRecordEntity)-[:ROOT_AT]->(:FileEntity)

//模块根目录 1:n

(:ModuleEntity)-[:MODULE_ROOT{

type: type//src testSrc resources testResources

}]->(:FileEntity)

6.PsiElementEntity

(:PsiElementEntity{//语法树

className：className//psiElement实现类

startOffset //文本开始位置

endOffset//文本结束位置

originText//原始文本

})

PsiElementEntity

id f30db139-4a90-4c10-b740-ac85514ab787

className com.intellij.psi.impl.source.PsiImportListImpl

startOffset 59

endOffset 857

originText 'java code'

createdAt 1680274076903

updatedAt 1680274076903

6.1.类

com.intellij.psi.impl.source.PsiClassImpl

$.qualifiedName str //全限定类名 com.a.b.c.ClassA

6.2.注解

com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl

$.qualifiedName str //全限定类名 com.a.b.c.AnnotationA

$.attributes arr //属性数组

$.attributes[i] obj

$.attributes[i].name str //属性名

$.attributes[i].values arr //属性值

$.attributes[i].values[i] str //属性值

//文件包含语法树根节点 1:n

(:FileEntity)-[:HAS_PSI_ELEMENTS]->(:PsiElementEntity)

//语法树包含关系 1:n

(:PsiElementEntity)-[:CONTAINS]->(:PsiElementEntity)

7.AnnotationAttrEntity

(:AnnotationAttrEntity{//注解属性

name

values

})

CREATE INDEX idx_psi_element_id IF NOT EXISTS FOR (m:PsiElementEntity) ON (m.id) ;

CREATE INDEX idx_psi_className IF NOT EXISTS FOR (m:PsiElementEntity) ON (m.className) ;

CREATE INDEX idx_psi_qualifiedName IF NOT EXISTS FOR (m:PsiElementEntity) ON (m.qualifiedName) ;

//注解关系 1:n

(:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiClassImpl'})-[:HAS_ANNOTATION]->(:PsiElementEntity{className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl'})

(:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiMethodImpl'})-[:HAS_ANNOTATION]->(:PsiElementEntity{className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl'})

//注解和注解属性的关系1:n

(:PsiElementEntity{className:"com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl"})-[:HAS_ATTR]->(:AnnotationAttrEntity)

8.ApiEndpointEntity

(:ApiEndpointEntity{

scanId: scanId,

method: httpMethod//RequestMethod.GET POST ....

path: "/1/2/3" // /api/public/1/2/3

})

CREATE INDEX idx_api_endpoint_scanId IF NOT EXISTS FOR (m:ApiEndpointEntity) ON (m.scanId) ;

CREATE INDEX idx_api_endpoint_path IF NOT EXISTS FOR (m:ApiEndpointEntity) ON (m.path) ;

//api入口绑定关系 1:n

(method:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiMethodImpl'})

-[:HAS_ANNOTATION]->

(methodAnnotation:PsiElementEntity{

className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl',

qualifiedName: 'org.springframework.web.bind.annotation.RequestMapping'

})

(method:PsiElementEntity)-[:HAS_ENDPOINT]->(:ApiEndPointEntity)

//查看IDEA日志

Get-Content .\build\idea-sandbox\system\log\idea.log -Tail 100 -Wait

//列出所有项目

MATCH (project:ProjectEntity)

RETURN project.key

//列出指定项目下的扫描记录

MATCH (project:ProjectEntity)-[:HAS_SCAN_RECORD]->(scanRecord:ScanRecordEntity)

WHERE project.key = "realworld-mdd"

RETURN scanRecord.scanId, scanRecord.createdAt

ORDER BY scanRecord.createdAt DESC

//查看某次扫描记录

MATCH (project:ProjectEntity)

-[:HAS_SCAN_RECORD]->

(scanRecord:ScanRecordEntity)

-[*]-

(related)

WHERE

scanRecord.scanId = "643e424c1b99436f82551420981669db"

RETURN project, scanRecord, related

// 查找要连接ModuleRoot的FileEntity和FileEntity

MATCH (scanRecord:ScanRecordEntity)-[rr:CONTAINS]->(module:ModuleEntity)-[rrr:MODULE_ROOT]->(moduleRoot:FileEntity)

MATCH (scanRecord)-[:ROOT_AT]->(:FileEntity)-[:CONTAINS*1..]->(srcRoot:FileEntity)

WHERE

scanRecord.scanId = "643e424c1b99436f82551420981669db" AND

moduleRoot.relativePath = srcRoot.relativePath AND

moduleRoot <> srcRoot

RETURN scanRecord, rr, module, rrr, moduleRoot, srcRoot

// 连接ModuleRoot的FileEntity和FileEntity

MATCH (scanRecord:ScanRecordEntity)-[rr:CONTAINS]->(module:ModuleEntity)-[rrr:MODULE_ROOT]->(moduleRoot:FileEntity)

MATCH (scanRecord)-[:ROOT_AT]->(:FileEntity)-[:CONTAINS*1..]->(srcRoot:FileEntity)

WHERE

scanRecord.scanId = "643e424c1b99436f82551420981669db" AND

moduleRoot.relativePath = srcRoot.relativePath AND

moduleRoot <> srcRoot

MERGE (moduleRoot)-[rrrr:SYMBOL_LINK]->(srcRoot)

RETURN scanRecord, rr, module, rrr, moduleRoot, rrrr, srcRoot

// 断开连接ModuleRoot的FileEntity和FileEntity

MATCH (scanRecord:ScanRecordEntity)-[rr:CONTAINS]->(module:ModuleEntity)-[rrr:MODULE_ROOT]->(moduleRoot:FileEntity)

MATCH (scanRecord)-[:ROOT_AT]->(:FileEntity)-[:CONTAINS*1..]->(srcRoot:FileEntity)

MATCH (moduleRoot)-[link:SYMBOL_LINK]->(srcRoot:FileEntity)

WHERE

scanRecord.scanId = "643e424c1b99436f82551420981669db" AND

moduleRoot.relativePath = srcRoot.relativePath AND

moduleRoot <> srcRoot

DELETE link

RETURN scanRecord, rr, module, rrr, moduleRoot, srcRoot

// -[:TYPE*minHops..maxHops]->

//使用这个连接查询后面的文件树

MATCH (project:ProjectEntity)

-[:HAS_SCAN_RECORD]->(scanRecord:ScanRecordEntity)

-[:CONTAINS]->(module:ModuleEntity)

-[:MODULE_ROOT]->(moduleRoot:FileEntity)

-[:SYMBOL_LINK]->(srcRoot:FileEntity)

-[:CONTAINS*1..]->(files)

WHERE

scanRecord.scanId = "643e424c1b99436f82551420981669db"

RETURN project, scanRecord, module, moduleRoot, srcRoot, files

//查找指定扫描记录里的单个文件

MATCH

(scanRecord:ScanRecordEntity)-[:ROOT_AT|CONTAINS*1..]->(file:FileEntity)

WHERE

scanRecord.scanId = "643e424c1b99436f82551420981669db"

AND

file.relativePath = "src\\main\\java\\cn\\hylstudio\\mdse\\demo\\realworld\\controller\\user\\UserController.java"

RETURN file

//查看指定文件的语法树

MATCH

(scanRecord:ScanRecordEntity)-[:ROOT_AT|CONTAINS*1..]->(file:FileEntity)

-[:HAS_PSI_ELEMENTS|CONTAINS*1..]->(elements:PsiElementEntity)

WHERE

scanRecord.scanId = "643e424c1b99436f82551420981669db"

AND

file.relativePath = "src\\main\\java\\cn\\hylstudio\\mdse\\demo\\realworld\\controller\\user\\UserController.java"

RETURN file,elements

//获取当前文件所有的语法树节点类型

// RETURN distinct(psiElements.className)

"com.intellij.psi.impl.source.tree.java.PsiPackageStatementImpl"

"com.intellij.psi.impl.source.tree.java.PsiKeywordImpl"

"com.intellij.psi.impl.source.PsiJavaCodeReferenceElementImpl"

"com.intellij.psi.impl.source.tree.java.PsiJavaTokenImpl"

"com.intellij.psi.impl.source.tree.java.PsiReferenceParameterListImpl"

"com.intellij.psi.impl.source.tree.java.PsiIdentifierImpl"

"com.intellij.psi.impl.source.tree.PsiWhiteSpaceImpl"

"com.intellij.psi.impl.source.PsiImportListImpl"

"com.intellij.psi.impl.source.PsiImportStatementImpl"

"com.intellij.psi.impl.source.PsiClassImpl"

"com.intellij.psi.impl.source.PsiMethodImpl"

"com.intellij.psi.impl.source.PsiModifierListImpl"

"com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl"

"com.intellij.psi.impl.source.tree.java.PsiAnnotationParamListImpl"

"com.intellij.psi.impl.source.tree.java.PsiNameValuePairImpl"

"com.intellij.psi.impl.source.tree.java.PsiReferenceExpressionImpl"

"com.intellij.psi.impl.source.tree.java.PsiLiteralExpressionImpl"

"com.intellij.psi.impl.source.PsiTypeElementImpl"

"com.intellij.psi.impl.source.PsiParameterListImpl"

"com.intellij.psi.impl.source.PsiParameterImpl"

"com.intellij.psi.impl.source.tree.java.PsiCodeBlockImpl"

"com.intellij.psi.impl.source.tree.java.PsiReturnStatementImpl"

"com.intellij.psi.impl.source.tree.java.PsiMethodCallExpressionImpl"

"com.intellij.psi.impl.source.tree.java.PsiExpressionListImpl"

"com.intellij.psi.impl.source.tree.java.PsiExpressionStatementImpl"

"com.intellij.psi.impl.source.tree.java.PsiDeclarationStatementImpl"

"com.intellij.psi.impl.source.tree.java.PsiLocalVariableImpl"

"com.intellij.psi.impl.source.tree.java.PsiIfStatementImpl"

"com.intellij.psi.impl.source.tree.java.PsiBlockStatementImpl"

"com.intellij.psi.impl.source.tree.java.PsiBinaryExpressionImpl"

"com.intellij.psi.impl.source.tree.java.PsiTypeParameterListImpl"

"com.intellij.psi.impl.source.PsiReferenceListImpl"

"com.intellij.psi.impl.source.tree.PsiCommentImpl"

"com.intellij.psi.impl.source.tree.java.PsiPrefixExpressionImpl"

"com.intellij.psi.impl.source.tree.java.PsiSwitchStatementImpl"

"com.intellij.psi.impl.source.tree.java.PsiSwitchLabelStatementImpl"

"com.intellij.psi.impl.source.tree.java.PsiCaseLabelElementListImpl"

"com.intellij.psi.impl.source.tree.java.PsiNewExpressionImpl"

"com.intellij.psi.impl.source.PsiDiamondTypeElementImpl"

"com.intellij.psi.impl.source.tree.java.PsiForeachStatementImpl"

"com.intellij.psi.impl.source.tree.java.PsiClassObjectAccessExpressionImpl"

"com.intellij.psi.impl.source.PsiFieldImpl"

"com.intellij.psi.impl.source.tree.java.PsiArrayInitializerMemberValueImpl"

"com.intellij.psi.impl.source.javadoc.PsiDocCommentImpl"

"com.intellij.psi.impl.source.javadoc.PsiDocTokenImpl"

//获取一个文件中的类、类的注解、类中的方法、方法注解，不使用HAS_ANNOTATION

MATCH (scanRecord:ScanRecordEntity)-[:ROOT_AT|CONTAINS*1..]->(file:FileEntity)

WHERE

scanRecord.scanId = "643e424c1b99436f82551420981669db"

AND

file.relativePath = "src\\main\\java\\cn\\hylstudio\\mdse\\demo\\realworld\\controller\\user\\UserController.java"

OPTIONAL MATCH (file)-[:HAS_PSI_ELEMENTS|CONTAINS*1..]->

//match class info

(class:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiClassImpl'})

OPTIONAL MATCH (class)-[:CONTAINS]->

(classModifierList:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiModifierListImpl'})

OPTIONAL MATCH (classModifierList)-[:CONTAINS]->

(classAnnotation:PsiElementEntity{className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl'})

OPTIONAL MATCH (classAnnotation)-[:HAS_ATTR]->

(classAnnotationAttr:AnnotationAttrEntity)

//match method info

OPTIONAL MATCH (class)-[:CONTAINS]->

(method:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiMethodImpl'})

OPTIONAL MATCH (method)-[:CONTAINS]->

(mehotdModifierList:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiModifierListImpl'})

OPTIONAL MATCH (mehotdModifierList)-[:CONTAINS]->

(methodAnnotation:PsiElementEntity{className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl'})

OPTIONAL MATCH (methodAnnotation)-[:HAS_ATTR]->

(methodAnnotationAttr:AnnotationAttrEntity)

return

class,classModifierList,classAnnotation,classAnnotationAttr,

method,mehotdModifierList,methodAnnotation,methodAnnotationAttr

//连接所有class和method上的注解

MATCH (scanRecord:ScanRecordEntity)-[:MODULE_ROOT|SYMBOL_LINK|CONTAINS*1..]->(file:FileEntity)

WHERE

scanRecord.scanId = "643e424c1b99436f82551420981669db"

AND

file.type = "file"

MATCH (file)-[:HAS_PSI_ELEMENTS|CONTAINS*1..]->

//match class info

(class:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiClassImpl'})

MATCH (class)-[:CONTAINS]->

(classModifierList:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiModifierListImpl'})

MATCH (classModifierList)-[:CONTAINS]->

(classAnnotation:PsiElementEntity{className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl'})

MATCH (classAnnotation)-[:HAS_ATTR]->

(classAnnotationAttr:AnnotationAttrEntity)

//match method info

MATCH (class)-[:CONTAINS]->

(method:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiMethodImpl'})

MATCH (method)-[:CONTAINS]->

(methodModifierList:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiModifierListImpl'})

MATCH (methodModifierList)-[:CONTAINS]->

(methodAnnotation:PsiElementEntity{className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl'})

MATCH (methodAnnotation)-[:HAS_ATTR]->

(methodAnnotationAttr:AnnotationAttrEntity)

MERGE (class)-[:HAS_ANNOTATION]->(classAnnotation)

MERGE (method)-[:HAS_ANNOTATION]->(methodAnnotation)

//获取一个文件中的类、类的注解、类中的方法、方法注解，使用HAS_ANNOTATION

MATCH (scanRecord:ScanRecordEntity)-[:ROOT_AT|CONTAINS*1..]->(file:FileEntity)

WHERE

scanRecord.scanId = "643e424c1b99436f82551420981669db"

AND

file.relativePath = "src\\main\\java\\cn\\hylstudio\\mdse\\demo\\realworld\\controller\\user\\UserController.java"

OPTIONAL MATCH (file)-[:HAS_PSI_ELEMENTS|CONTAINS*1..]->

//match class info

(class:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiClassImpl'})

OPTIONAL MATCH (class)-[:HAS_ANNOTATION]->

(classAnnotation:PsiElementEntity{className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl'})

OPTIONAL MATCH (classAnnotation)-[:HAS_ATTR]->

(classAnnotationAttr:AnnotationAttrEntity)

//match method info

OPTIONAL MATCH (class)-[:CONTAINS]->

(method:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiMethodImpl'})

OPTIONAL MATCH (method)-[:HAS_ANNOTATION]->

(methodAnnotation:PsiElementEntity{className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl'})

OPTIONAL MATCH (methodAnnotation)-[:HAS_ATTR]->

(methodAnnotationAttr:AnnotationAttrEntity)

return

class,classAnnotation,classAnnotationAttr,

method,methodAnnotation,methodAnnotationAttr

//单个文件，根据注解查询Api入口，并关联到方法上

MATCH (scanRecord:ScanRecordEntity)-[:ROOT_AT|CONTAINS*1..]->(file:FileEntity)

WHERE

scanRecord.scanId = "643e424c1b99436f82551420981669db"

AND

file.relativePath = "src\\main\\java\\cn\\hylstudio\\mdse\\demo\\realworld\\controller\\user\\UserController.java"

MATCH (file)-[:HAS_PSI_ELEMENTS|CONTAINS*1..]->

//match class info

(class:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiClassImpl'})

OPTIONAL MATCH (class)-[:HAS_ANNOTATION]->

(classAnnotation:PsiElementEntity{

className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl',

qualifiedName: 'org.springframework.web.bind.annotation.RequestMapping'

})

MATCH (classAnnotation)-[:HAS_ATTR]->

(classAnnotationAttr:AnnotationAttrEntity{name:"value"})

//match method info

MATCH (class)-[:CONTAINS]->

(method:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiMethodImpl'})

MATCH (method)-[:HAS_ANNOTATION]->

(methodAnnotation:PsiElementEntity{

className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl',

qualifiedName: 'org.springframework.web.bind.annotation.RequestMapping'

})

MATCH (methodAnnotation)-[:HAS_ATTR]->

(apiPathsOnMethod:AnnotationAttrEntity{name:"value"})

MATCH (methodAnnotation)-[:HAS_ATTR]->

(apiMethods:AnnotationAttrEntity{name:"method"})

UNWIND classAnnotationAttr.values AS prefix

UNWIND apiMethods.values AS httpMethod

UNWIND apiPathsOnMethod.values AS path

MERGE (method)-[:HAS_ENDPOINT]->(apiEndpoint:ApiEndpointEntity{method: httpMethod, path: prefix + path})

RETURN method, apiEndpoint

//全量文件，根据注解生成Api入口，并关联到方法和扫描记录上

MATCH (scanRecord:ScanRecordEntity)-[:MODULE_ROOT|SYMBOL_LINK|CONTAINS*1..]->(file:FileEntity)

WHERE

scanRecord.scanId = "643e424c1b99436f82551420981669db"

AND

file.type = "file"

MATCH (file)-[:HAS_PSI_ELEMENTS|CONTAINS*1..]->

//match class info

(class:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiClassImpl'})

OPTIONAL MATCH (class)-[:HAS_ANNOTATION]->

(classAnnotation:PsiElementEntity{

className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl',

qualifiedName: 'org.springframework.web.bind.annotation.RequestMapping'

})

MATCH (classAnnotation)-[:HAS_ATTR]->

(classAnnotationAttr:AnnotationAttrEntity{name:"value"})

//match method info

MATCH (class)-[:CONTAINS]->

(method:PsiElementEntity{className:'com.intellij.psi.impl.source.PsiMethodImpl'})

MATCH (method)-[:HAS_ANNOTATION]->

(methodAnnotation:PsiElementEntity{

className:'com.intellij.psi.impl.source.tree.java.PsiAnnotationImpl',

qualifiedName: 'org.springframework.web.bind.annotation.RequestMapping'

})

MATCH (methodAnnotation)-[:HAS_ATTR]->

(apiPathsOnMethod:AnnotationAttrEntity{name:"value"})

MATCH (methodAnnotation)-[:HAS_ATTR]->

(apiMethods:AnnotationAttrEntity{name:"method"})

UNWIND classAnnotationAttr.values AS prefix

UNWIND apiMethods.values AS httpMethod

UNWIND apiPathsOnMethod.values AS path

MERGE (apiEndpoint:ApiEndpointEntity {scanId: scanRecord.scanId, method: httpMethod, path: prefix + path})

MERGE (method)-[:HAS_ENDPOINT]->(apiEndpoint)

MERGE (scanRecord)-[:HAS_ENDPOINT]->(apiEndpoint)

RETURN method, apiEndpoint

//查找所有ApiEndpoint

MATCH (scanRecord:ScanRecordEntity)-[:HAS_ENDPOINT]->(apiEndpoint:ApiEndpointEntity)

WHERE

scanRecord.scanId = "643e424c1b99436f82551420981669db"

RETURN apiEndpoint

参考

https://arxiv.org/pdf/2302.04761.pdf

https://arxiv.org/pdf/2211.10435.pdf

20230204尝试搭建k8s青春版

视频版

https://www.bilibili.com/video/BV1qj411T7d5/

背景

之前一直想搭建k8s，但按多年前的印象这玩意很复杂。今天先尝试个青春版k3s

安装准备

按文档说是离线在线都行，离线的需要个私有的镜像中心，但镜像中心最简便的搭建方式是跑个容器。。。死循环了啊，所以先试在线的。

家里的资源不多，尝试做个乞丐版，2~3节点就行了，先弄单机后面再加worker

环境要求

硬件按文档建议是最少1c1g，我就给2c2g吧，机器数量是2

系统要求Ubuntu是22.04

可以使用 --with-node-id 给每个节点后面增加一个随机的后缀。或者使用命令行参数 --node-name 或环境变量 $K3S_NODE_NAME 给集群的每个节点传递唯一的名字

网络每个节点需要6443 可以被访问

Flannel VXLAN 节点间通过 UDP 8472 通信

Flannel Wireguard backend 节点间通过 UDP 51820(ipv4) 51821(ipv6)

安装过程


k3s1@k3s1:~$ curl -sfL https://get.k3s.io | sh -
[sudo] password for k3s1:
[INFO]  Finding release for channel stable
[INFO]  Using v1.25.6+k3s1 as release
[INFO]  Downloading hash https://github.com/k3s-io/k3s/releases/download/v1.25.6+k3s1/sha256sum-amd64.txt
[INFO]  Downloading binary https://github.com/k3s-io/k3s/releases/download/v1.25.6+k3s1/k3s
[INFO]  Verifying binary download
[INFO]  Installing k3s to /usr/local/bin/k3s
[INFO]  Skipping installation of SELinux RPM
[INFO]  Creating /usr/local/bin/kubectl symlink to k3s
[INFO]  Creating /usr/local/bin/crictl symlink to k3s
[INFO]  Creating /usr/local/bin/ctr symlink to k3s
[INFO]  Creating killall script /usr/local/bin/k3s-killall.sh
[INFO]  Creating uninstall script /usr/local/bin/k3s-uninstall.sh
[INFO]  env: Creating environment file /etc/systemd/system/k3s.service.env
[INFO]  systemd: Creating service file /etc/systemd/system/k3s.service
[INFO]  systemd: Enabling k3s unit
Created symlink /etc/systemd/system/multi-user.target.wants/k3s.service → /etc/systemd/system/k3s.service.

k3s1@k3s1:~$ curl -sfL https://get.k3s.io | sh -

[sudo] password for k3s1:

[INFO] Finding release for channel stable

[INFO] Using v1.25.6+k3s1 as release

[INFO] Downloading hash https://github.com/k3s-io/k3s/releases/download/v1.25.6+k3s1/sha256sum-amd64.txt

[INFO] Downloading binary https://github.com/k3s-io/k3s/releases/download/v1.25.6+k3s1/k3s

[INFO] Verifying binary download

[INFO] Installing k3s to /usr/local/bin/k3s

[INFO] Skipping installation of SELinux RPM

[INFO] Creating /usr/local/bin/kubectl symlink to k3s

[INFO] Creating /usr/local/bin/crictl symlink to k3s

[INFO] Creating /usr/local/bin/ctr symlink to k3s

[INFO] Creating killall script /usr/local/bin/k3s-killall.sh

[INFO] Creating uninstall script /usr/local/bin/k3s-uninstall.sh

[INFO] env: Creating environment file /etc/systemd/system/k3s.service.env

[INFO] systemd: Creating service file /etc/systemd/system/k3s.service

[INFO] systemd: Enabling k3s unit

Created symlink /etc/systemd/system/multi-user.target.wants/k3s.service → /etc/systemd/system/k3s.service.

主节点安装过程如上，疑似成功。。。

查看进程如下，可以看到/run/k3s/containerd/containerd.sock说明containerd已经在运行了


k3s1@k3s1:~$ ps aux|grep k3s
k3s1        1757  0.0  0.4  19152  9796 ?        Ss   11:25   0:00 /lib/systemd/systemd --user
k3s1        1759  0.0  0.2 105292  4420 ?        S    11:25   0:00 (sd-pam)
k3s1        1769  0.0  0.2   8264  5192 tty1     S+   11:25   0:00 -bash
root        2406  0.0  0.4  13788  9016 ?        Ss   11:29   0:00 sshd: k3s1 [priv]
k3s1        2478  0.0  0.3  13924  6000 ?        R    11:29   0:00 sshd: k3s1@pts/0
k3s1        2479  0.0  0.2   8276  5288 pts/0    Ss   11:29   0:00 -bash
root        2727 33.2 22.3 1194116 447444 ?      Ssl  11:31   1:01 /usr/local/bin/k3s server
root        2772 11.0  3.7 771044 75764 ?        Sl   11:31   0:19 containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml -a /run/k3s/containerd/containerd.sock --state /run/k3s/containerd --root /var/lib/rancher/k3s/agent/containerd
root        3467  0.1  0.5 720748 10652 ?        Sl   11:32   0:00 /var/lib/rancher/k3s/data/630c40ff866a3db218a952ebd4fd2a5cfe1543a1a467e738cb46a2ad4012d6f1/bin/containerd-shim-runc-v2 -namespace k8s.io -id 9b07e1b9470f0e657d9a00667c44bb955e3d5c7f049036adfd38d086d73026e1 -address /run/k3s/containerd/containerd.sock
root        3511  0.1  0.5 721004 10740 ?        Sl   11:32   0:00 /var/lib/rancher/k3s/data/630c40ff866a3db218a952ebd4fd2a5cfe1543a1a467e738cb46a2ad4012d6f1/bin/containerd-shim-runc-v2 -namespace k8s.io -id 65fba4a19627e12286bbdb2056f27f1c063c060255510b9b997e291a44e1c736 -address /run/k3s/containerd/containerd.sock
root        3521  0.0  0.4 720748  9852 ?        Sl   11:32   0:00 /var/lib/rancher/k3s/data/630c40ff866a3db218a952ebd4fd2a5cfe1543a1a467e738cb46a2ad4012d6f1/bin/containerd-shim-runc-v2 -namespace k8s.io -id 3193ac9aa5db3faec494a7fa431c2bbed4c9a124c67042ef956ba1f1b08783b0 -address /run/k3s/containerd/containerd.sock
root        3538  0.0  0.5 720748 10972 ?        Sl   11:32   0:00 /var/lib/rancher/k3s/data/630c40ff866a3db218a952ebd4fd2a5cfe1543a1a467e738cb46a2ad4012d6f1/bin/containerd-shim-runc-v2 -namespace k8s.io -id bed5712d5e71c22a2b4863c61df5402ed3cd2e468b89b3699f3b2db48ea2f522 -address /run/k3s/containerd/containerd.sock
root        3563  0.0  0.5 720492 10208 ?        Sl   11:32   0:00 /var/lib/rancher/k3s/data/630c40ff866a3db218a952ebd4fd2a5cfe1543a1a467e738cb46a2ad4012d6f1/bin/containerd-shim-runc-v2 -namespace k8s.io -id b76d14ccfaa1a5743f4fa77aef74c210b89badd130c75244e8561dffa643cdba -address /run/k3s/containerd/containerd.sock
k3s1        3944  6.1  2.3 751748 47708 ?        Ssl  11:32   0:04 /metrics-server --cert-dir=/tmp --secure-port=10250 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=15s
k3s1        4181  0.0  0.1   9128  3480 pts/0    R+   11:34   0:00 ps aux
k3s1        4182  0.0  0.0   6432   720 pts/0    S+   11:34   0:00 grep --color=auto k3s

k3s1@k3s1:~$ ps aux|grep k3s

k3s1 1757 0.0 0.4 19152 9796 ? Ss 11:25 0:00 /lib/systemd/systemd --user

k3s1 1759 0.0 0.2 105292 4420 ? S 11:25 0:00 (sd-pam)

k3s1 1769 0.0 0.2 8264 5192 tty1 S+ 11:25 0:00 -bash

root 2406 0.0 0.4 13788 9016 ? Ss 11:29 0:00 sshd: k3s1 [priv]

k3s1 2478 0.0 0.3 13924 6000 ? R 11:29 0:00 sshd: k3s1@pts/0

k3s1 2479 0.0 0.2 8276 5288 pts/0 Ss 11:29 0:00 -bash

root 2727 33.2 22.3 1194116 447444 ? Ssl 11:31 1:01 /usr/local/bin/k3s server

root 2772 11.0 3.7 771044 75764 ? Sl 11:31 0:19 containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml -a /run/k3s/containerd/containerd.sock --state /run/k3s/containerd --root /var/lib/rancher/k3s/agent/containerd

root 3467 0.1 0.5 720748 10652 ? Sl 11:32 0:00 /var/lib/rancher/k3s/data/630c40ff866a3db218a952ebd4fd2a5cfe1543a1a467e738cb46a2ad4012d6f1/bin/containerd-shim-runc-v2 -namespace k8s.io -id 9b07e1b9470f0e657d9a00667c44bb955e3d5c7f049036adfd38d086d73026e1 -address /run/k3s/containerd/containerd.sock

root 3511 0.1 0.5 721004 10740 ? Sl 11:32 0:00 /var/lib/rancher/k3s/data/630c40ff866a3db218a952ebd4fd2a5cfe1543a1a467e738cb46a2ad4012d6f1/bin/containerd-shim-runc-v2 -namespace k8s.io -id 65fba4a19627e12286bbdb2056f27f1c063c060255510b9b997e291a44e1c736 -address /run/k3s/containerd/containerd.sock

root 3521 0.0 0.4 720748 9852 ? Sl 11:32 0:00 /var/lib/rancher/k3s/data/630c40ff866a3db218a952ebd4fd2a5cfe1543a1a467e738cb46a2ad4012d6f1/bin/containerd-shim-runc-v2 -namespace k8s.io -id 3193ac9aa5db3faec494a7fa431c2bbed4c9a124c67042ef956ba1f1b08783b0 -address /run/k3s/containerd/containerd.sock

root 3538 0.0 0.5 720748 10972 ? Sl 11:32 0:00 /var/lib/rancher/k3s/data/630c40ff866a3db218a952ebd4fd2a5cfe1543a1a467e738cb46a2ad4012d6f1/bin/containerd-shim-runc-v2 -namespace k8s.io -id bed5712d5e71c22a2b4863c61df5402ed3cd2e468b89b3699f3b2db48ea2f522 -address /run/k3s/containerd/containerd.sock

root 3563 0.0 0.5 720492 10208 ? Sl 11:32 0:00 /var/lib/rancher/k3s/data/630c40ff866a3db218a952ebd4fd2a5cfe1543a1a467e738cb46a2ad4012d6f1/bin/containerd-shim-runc-v2 -namespace k8s.io -id b76d14ccfaa1a5743f4fa77aef74c210b89badd130c75244e8561dffa643cdba -address /run/k3s/containerd/containerd.sock

k3s1 3944 6.1 2.3 751748 47708 ? Ssl 11:32 0:04 /metrics-server --cert-dir=/tmp --secure-port=10250 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=15s

k3s1 4181 0.0 0.1 9128 3480 pts/0 R+ 11:34 0:00 ps aux

k3s1 4182 0.0 0.0 6432 720 pts/0 S+ 11:34 0:00 grep --color=auto k3s

metrics-server不知道是干什么的，后面再翻翻文档。

网络监听情况如下，可以看到大部分都是本地监听，只有10250 6443是有可能对外开放的

按文档描述是个TCP的端口监听，看起来和metrics server进程有关，好像是kubelet在节点之间通讯使用的。官方原文：If you wish to utilize the metrics server, all nodes must be accessible to each other on port 10250.

6443是TCP的监听，流量方向是从Agent向Server的，应该是worker节点向master注册数据用的。官方描述为 supervisor and Kubernetes API Server


k3s1@k3s1:~$ netstat -anp|grep LISTEN
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
tcp        0      0 127.0.0.1:10010         0.0.0.0:*               LISTEN      -
tcp        0      0 127.0.0.1:10248         0.0.0.0:*               LISTEN      -
tcp        0      0 127.0.0.1:10249         0.0.0.0:*               LISTEN      -
tcp        0      0 127.0.0.1:6444          0.0.0.0:*               LISTEN      -
tcp        0      0 127.0.0.1:10256         0.0.0.0:*               LISTEN      -
tcp        0      0 127.0.0.1:10257         0.0.0.0:*               LISTEN      -
tcp        0      0 127.0.0.1:10258         0.0.0.0:*               LISTEN      -
tcp        0      0 127.0.0.1:10259         0.0.0.0:*               LISTEN      -
tcp        0      0 127.0.0.53:53           0.0.0.0:*               LISTEN      -
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -
tcp6       0      0 :::10250                :::*                    LISTEN      -
tcp6       0      0 :::6443                 :::*                    LISTEN      -
tcp6       0      0 :::22                   :::*                    LISTEN      -

k3s1@k3s1:~$ netstat -anp|grep LISTEN

(Not all processes could be identified, non-owned process info

will not be shown, you would have to be root to see it all.)

tcp 0 0 127.0.0.1:10010 0.0.0.0:* LISTEN -

tcp 0 0 127.0.0.1:10248 0.0.0.0:* LISTEN -

tcp 0 0 127.0.0.1:10249 0.0.0.0:* LISTEN -

tcp 0 0 127.0.0.1:6444 0.0.0.0:* LISTEN -

tcp 0 0 127.0.0.1:10256 0.0.0.0:* LISTEN -

tcp 0 0 127.0.0.1:10257 0.0.0.0:* LISTEN -

tcp 0 0 127.0.0.1:10258 0.0.0.0:* LISTEN -

tcp 0 0 127.0.0.1:10259 0.0.0.0:* LISTEN -

tcp 0 0 127.0.0.53:53 0.0.0.0:* LISTEN -

tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN -

tcp6 0 0 :::10250 :::* LISTEN -

tcp6 0 0 :::6443 :::* LISTEN -

tcp6 0 0 :::22 :::* LISTEN -

按文档所说配置文件内容如下


k3s1@k3s1:~$ sudo cat /etc/rancher/k3s/k3s.yaml
apiVersion: v1
clusters:
- cluster:
    certificate-authority-data: LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUJkakNDQVIyZ0F3SUJBZ0lCQURBS0JnZ3Foa2pPUFFRREFqQWpNU0V3SHdZRFZRUUREQmhyTTNNdGMyVnkKZG1WeUxXTmhRREUyTnpVMU1UQXlOemt3SGhjTk1qTXdNakEwTVRFek1URTVXaGNOTXpNd01qQXhNVEV6TVRFNQpXakFqTVNFd0h3WURWUVFEREJock0zTXRjMlZ5ZG1WeUxXTmhRREUyTnpVMU1UQXlOemt3V1RBVEJnY3Foa2pPClBRSUJCZ2dxaGtqT1BRTUJCd05DQUFTS0lXTmNvbWZleEhPcndCVjUwdWx5ZjkwQlo2a0sxOStGUW9GN0pNUloKYi9UdndyZW9vNXhwWHNNekpEYlVUWkFzUXdlOXBDK3BoTjRaQ2ZFNVloRlVvMEl3UURBT0JnTlZIUThCQWY4RQpCQU1DQXFRd0R3WURWUjBUQVFIL0JBVXdBd0VCL3pBZEJnTlZIUTRFRmdRVURPelE3YkFldXh2a3JZN1hnSDI1CkNDOGpRcFF3Q2dZSUtvWkl6ajBFQXdJRFJ3QXdSQUlnYW5rMlprZncrSHZCdHBvNnBuYmJiRDRuSExHSzlRZ3YKZFRLZTY3dm8zWVVDSUNtK0pJdisxSzBBcUpmUXA5L1JkdDRoMkF6Slc1WW5CenVIYzdLckhiRHgKLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
    server: https://127.0.0.1:6443
  name: default
contexts:
- context:
    cluster: default
    user: default
  name: default
current-context: default
kind: Config
preferences: {}
users:
- name: default
  user:
    client-certificate-data: LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUJrakNDQVRlZ0F3SUJBZ0lJVmVMRW9qM1NqUUV3Q2dZSUtvWkl6ajBFQXdJd0l6RWhNQjhHQTFVRUF3d1kKYXpOekxXTnNhV1Z1ZEMxallVQXhOamMxTlRFd01qYzVNQjRYRFRJek1ESXdOREV4TXpFeE9Wb1hEVEkwTURJdwpOREV4TXpFeE9Wb3dNREVYTUJVR0ExVUVDaE1PYzNsemRHVnRPbTFoYzNSbGNuTXhGVEFUQmdOVkJBTVRESE41CmMzUmxiVHBoWkcxcGJqQlpNQk1HQnlxR1NNNDlBZ0VHQ0NxR1NNNDlBd0VIQTBJQUJBSld6ZVpTK0h6bHZCMkgKMkVJUUh5bEZQL3pDMmpZTktoZGtLTFF0NjhtTENWNnpKRWhxVDhYby9EUXdoc20zL2tmQWp1QlJ2R0tRNmsvRgpONDRIU0oyalNEQkdNQTRHQTFVZER3RUIvd1FFQXdJRm9EQVRCZ05WSFNVRUREQUtCZ2dyQmdFRkJRY0RBakFmCkJnTlZIU01FR0RBV2dCUUdCNlk4LzB5MjhSbmJnemdsejRxcXNURE5QekFLQmdncWhrak9QUVFEQWdOSkFEQkcKQWlFQTcybUw5b1dKeDM0SzZOZlVsWGp2dEQ5WXRJQXZuMWFuUUJkeHlXSUhOYThDSVFEUFllK3RZemtFR0RNbAppcnlkVTJpTHM0dWdVdXpwQThqM1Q2bEd4MU1nYUE9PQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCi0tLS0tQkVHSU4gQ0VSVElGSUNBVEUtLS0tLQpNSUlCZURDQ0FSMmdBd0lCQWdJQkFEQUtCZ2dxaGtqT1BRUURBakFqTVNFd0h3WURWUVFEREJock0zTXRZMnhwClpXNTBMV05oUURFMk56VTFNVEF5Tnprd0hoY05Nak13TWpBME1URXpNVEU1V2hjTk16TXdNakF4TVRFek1URTUKV2pBak1TRXdId1lEVlFRRERCaHJNM010WTJ4cFpXNTBMV05oUURFMk56VTFNVEF5Tnprd1dUQVRCZ2NxaGtqTwpQUUlCQmdncWhrak9QUU1CQndOQ0FBUjB1cWV6cUh6S2owRUt2dFdNZ1YrQ09mblk0aGU3UFVLdnZlMWQ4d0VJCjFhb2laYjdzM05lK3ZvMzBQRkY5ZzdVZksrdGVJVjYxem80UytqVm9YU0k0bzBJd1FEQU9CZ05WSFE4QkFmOEUKQkFNQ0FxUXdEd1lEVlIwVEFRSC9CQVV3QXdFQi96QWRCZ05WSFE0RUZnUVVCZ2VtUFA5TXR2RVoyNE00SmMrSwpxckV3elQ4d0NnWUlLb1pJemowRUF3SURTUUF3UmdJaEFNVUlXUEExeXZYdEJsUUpFRER2aUtyM1hYbVJWb2hyClZGK3YzK0h4VXVGSUFpRUF5cmFhZlRiRG4vaTBwUmNHWnVEOHIzaTZQWHlJbUo0M1FpQnpLbHVjcnBFPQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
    client-key-data: LS0tLS1CRUdJTiBFQyBQUklWQVRFIEtFWS0tLS0tCk1IY0NBUUVFSUJzaUxpNU1NaG5wbUpXclJtSkxETUZobDVBSVcxTEQrS0tPRzBFRTlzc2RvQW9HQ0NxR1NNNDkKQXdFSG9VUURRZ0FFQWxiTjVsTDRmT1c4SFlmWVFoQWZLVVUvL01MYU5nMHFGMlFvdEMzcnlZc0pYck1rU0dwUAp4ZWo4TkRDR3liZitSOENPNEZHOFlwRHFUOFUzamdkSW5RPT0KLS0tLS1FTkQgRUMgUFJJVkFURSBLRVktLS0tLQo=

k3s1@k3s1:~$ sudo cat /etc/rancher/k3s/k3s.yaml

apiVersion: v1

clusters:

- cluster:

certificate-authority-data: LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUJkakNDQVIyZ0F3SUJBZ0lCQURBS0JnZ3Foa2pPUFFRREFqQWpNU0V3SHdZRFZRUUREQmhyTTNNdGMyVnkKZG1WeUxXTmhRREUyTnpVMU1UQXlOemt3SGhjTk1qTXdNakEwTVRFek1URTVXaGNOTXpNd01qQXhNVEV6TVRFNQpXakFqTVNFd0h3WURWUVFEREJock0zTXRjMlZ5ZG1WeUxXTmhRREUyTnpVMU1UQXlOemt3V1RBVEJnY3Foa2pPClBRSUJCZ2dxaGtqT1BRTUJCd05DQUFTS0lXTmNvbWZleEhPcndCVjUwdWx5ZjkwQlo2a0sxOStGUW9GN0pNUloKYi9UdndyZW9vNXhwWHNNekpEYlVUWkFzUXdlOXBDK3BoTjRaQ2ZFNVloRlVvMEl3UURBT0JnTlZIUThCQWY4RQpCQU1DQXFRd0R3WURWUjBUQVFIL0JBVXdBd0VCL3pBZEJnTlZIUTRFRmdRVURPelE3YkFldXh2a3JZN1hnSDI1CkNDOGpRcFF3Q2dZSUtvWkl6ajBFQXdJRFJ3QXdSQUlnYW5rMlprZncrSHZCdHBvNnBuYmJiRDRuSExHSzlRZ3YKZFRLZTY3dm8zWVVDSUNtK0pJdisxSzBBcUpmUXA5L1JkdDRoMkF6Slc1WW5CenVIYzdLckhiRHgKLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=

server: https://127.0.0.1:6443

contexts:

- context:

cluster: default

user: default

current-context: default

kind: Config

preferences: {}

users:

- name: default

user:

client-certificate-data: LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUJrakNDQVRlZ0F3SUJBZ0lJVmVMRW9qM1NqUUV3Q2dZSUtvWkl6ajBFQXdJd0l6RWhNQjhHQTFVRUF3d1kKYXpOekxXTnNhV1Z1ZEMxallVQXhOamMxTlRFd01qYzVNQjRYRFRJek1ESXdOREV4TXpFeE9Wb1hEVEkwTURJdwpOREV4TXpFeE9Wb3dNREVYTUJVR0ExVUVDaE1PYzNsemRHVnRPbTFoYzNSbGNuTXhGVEFUQmdOVkJBTVRESE41CmMzUmxiVHBoWkcxcGJqQlpNQk1HQnlxR1NNNDlBZ0VHQ0NxR1NNNDlBd0VIQTBJQUJBSld6ZVpTK0h6bHZCMkgKMkVJUUh5bEZQL3pDMmpZTktoZGtLTFF0NjhtTENWNnpKRWhxVDhYby9EUXdoc20zL2tmQWp1QlJ2R0tRNmsvRgpONDRIU0oyalNEQkdNQTRHQTFVZER3RUIvd1FFQXdJRm9EQVRCZ05WSFNVRUREQUtCZ2dyQmdFRkJRY0RBakFmCkJnTlZIU01FR0RBV2dCUUdCNlk4LzB5MjhSbmJnemdsejRxcXNURE5QekFLQmdncWhrak9QUVFEQWdOSkFEQkcKQWlFQTcybUw5b1dKeDM0SzZOZlVsWGp2dEQ5WXRJQXZuMWFuUUJkeHlXSUhOYThDSVFEUFllK3RZemtFR0RNbAppcnlkVTJpTHM0dWdVdXpwQThqM1Q2bEd4MU1nYUE9PQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCi0tLS0tQkVHSU4gQ0VSVElGSUNBVEUtLS0tLQpNSUlCZURDQ0FSMmdBd0lCQWdJQkFEQUtCZ2dxaGtqT1BRUURBakFqTVNFd0h3WURWUVFEREJock0zTXRZMnhwClpXNTBMV05oUURFMk56VTFNVEF5Tnprd0hoY05Nak13TWpBME1URXpNVEU1V2hjTk16TXdNakF4TVRFek1URTUKV2pBak1TRXdId1lEVlFRRERCaHJNM010WTJ4cFpXNTBMV05oUURFMk56VTFNVEF5Tnprd1dUQVRCZ2NxaGtqTwpQUUlCQmdncWhrak9QUU1CQndOQ0FBUjB1cWV6cUh6S2owRUt2dFdNZ1YrQ09mblk0aGU3UFVLdnZlMWQ4d0VJCjFhb2laYjdzM05lK3ZvMzBQRkY5ZzdVZksrdGVJVjYxem80UytqVm9YU0k0bzBJd1FEQU9CZ05WSFE4QkFmOEUKQkFNQ0FxUXdEd1lEVlIwVEFRSC9CQVV3QXdFQi96QWRCZ05WSFE0RUZnUVVCZ2VtUFA5TXR2RVoyNE00SmMrSwpxckV3elQ4d0NnWUlLb1pJemowRUF3SURTUUF3UmdJaEFNVUlXUEExeXZYdEJsUUpFRER2aUtyM1hYbVJWb2hyClZGK3YzK0h4VXVGSUFpRUF5cmFhZlRiRG4vaTBwUmNHWnVEOHIzaTZQWHlJbUo0M1FpQnpLbHVjcnBFPQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==

client-key-data: LS0tLS1CRUdJTiBFQyBQUklWQVRFIEtFWS0tLS0tCk1IY0NBUUVFSUJzaUxpNU1NaG5wbUpXclJtSkxETUZobDVBSVcxTEQrS0tPRzBFRTlzc2RvQW9HQ0NxR1NNNDkKQXdFSG9VUURRZ0FFQWxiTjVsTDRmT1c4SFlmWVFoQWZLVVUvL01MYU5nMHFGMlFvdEMzcnlZc0pYck1rU0dwUAp4ZWo4TkRDR3liZitSOENPNEZHOFlwRHFUOFUzamdkSW5RPT0KLS0tLS1FTkQgRUMgUFJJVkFURSBLRVktLS0tLQo=

按文档描述会生成这几个相关命令kubectl, crictl, k3s-killall.sh, and k3s-uninstall.sh。具体位置如下，均在/usr/local/bin下，所以可以从任意目录执行。

说实话k3s-killall.sh和k3s-uninstall.sh感觉并不适合放进这个位置，不知道是不是官方怕你找不到故意也放bin里了，这俩实际生产场景下完全没有全局任意目录运行的必要。万一误执行了就GG


k3s1@k3s1:~$ which kubectl
/usr/local/bin/kubectl
k3s1@k3s1:~$ which crictl
/usr/local/bin/crictl
k3s1@k3s1:~$ which k3s-killall.sh
/usr/local/bin/k3s-killall.sh
k3s1@k3s1:~$ which k3s-uninstall.sh
/usr/local/bin/k3s-uninstall.sh

k3s1@k3s1:~$ which kubectl

/usr/local/bin/kubectl

k3s1@k3s1:~$ which crictl

/usr/local/bin/crictl

k3s1@k3s1:~$ which k3s-killall.sh

/usr/local/bin/k3s-killall.sh

k3s1@k3s1:~$ which k3s-uninstall.sh

/usr/local/bin/k3s-uninstall.sh

尝试获取当前集群的节点，虽然知道只有一个，但需要看看命令是不是能正常执行，别和之前有的服务一样看着没事但实际没正常运行。。。。


k3s1@k3s1:~$ sudo kubectl get nodes
NAME   STATUS   ROLES                  AGE   VERSION
k3s1   Ready    control-plane,master   14m   v1.25.6+k3s1

k3s1@k3s1:~$ sudo kubectl get nodes

NAME STATUS ROLES AGE VERSION

k3s1 Ready control-plane,master 14m v1.25.6+k3s1

这里有个需要关注的东西就是ROLES都有啥，需要看文档了。目前的control-plane顾名思义是控制面, master是主节点。不知道k8s的角色分配是不是和CDH一样能灵活转移。。。

查看TOKEN，准备安装第一个worker节点，按文档描述在这里/var/lib/rancher/k3s/server/node-token

注意，我在一个隔离环境测试，所以/var/lib/rancher/k3s/server/node-token和/etc/rancher/k3s/k3s.yaml的内容暴露了无所谓，待会会直接删除虚机，生产的千万不要轻易暴露。


sudo cat /var/lib/rancher/k3s/server/node-token
K100772d3a421be961da31afce5338280032a42ad8a152c683d22a0d2d72040af71::server:5840b68a95f662baf09269b2eceb7ce9

sudo cat /var/lib/rancher/k3s/server/node-token

K100772d3a421be961da31afce5338280032a42ad8a152c683d22a0d2d72040af71::server:5840b68a95f662baf09269b2eceb7ce9

按要求拼接worker的安装命令如下，到第二个机器上执行


curl -sfL https://get.k3s.io | K3S_URL=https://k3s1.k3s.local:6443 K3S_TOKEN=K100772d3a421be961da31afce5338280032a42ad8a152c683d22a0d2d72040af71::server:5840b68a95f662baf09269b2eceb7ce9 sh -

0 1	curl -sfL https://get.k3s.io \| K3S_URL=https://k3s1.k3s.local:6443 K3S_TOKEN=K100772d3a421be961da31afce5338280032a42ad8a152c683d22a0d2d72040af71::server:5840b68a95f662baf09269b2eceb7ce9 sh -

执行到systemd卡住了（后面已确认只是单纯的慢）


k3s2@k3s2:~$ curl -sfL https://get.k3s.io | K3S_URL=https://k3s1.k3s.local:6443 K3S_TOKEN=K100772d3a421be961da31afce5338280032a42ad8a152c683d22a0d2d72040af71::server:5840b68a95f662baf09269b2eceb7ce9 sh -
[sudo] password for k3s2:
[INFO]  Finding release for channel stable
[INFO]  Using v1.25.6+k3s1 as release
[INFO]  Downloading hash https://github.com/k3s-io/k3s/releases/download/v1.25.6+k3s1/sha256sum-amd64.txt
[INFO]  Downloading binary https://github.com/k3s-io/k3s/releases/download/v1.25.6+k3s1/k3s
[INFO]  Verifying binary download
[INFO]  Installing k3s to /usr/local/bin/k3s
[INFO]  Skipping installation of SELinux RPM
[INFO]  Creating /usr/local/bin/kubectl symlink to k3s
[INFO]  Creating /usr/local/bin/crictl symlink to k3s
[INFO]  Creating /usr/local/bin/ctr symlink to k3s
[INFO]  Creating killall script /usr/local/bin/k3s-killall.sh
[INFO]  Creating uninstall script /usr/local/bin/k3s-agent-uninstall.sh
[INFO]  env: Creating environment file /etc/systemd/system/k3s-agent.service.env
[INFO]  systemd: Creating service file /etc/systemd/system/k3s-agent.service
[INFO]  systemd: Enabling k3s-agent unit
Created symlink /etc/systemd/system/multi-user.target.wants/k3s-agent.service → /etc/systemd/system/k3s-agent.service.
[INFO]  systemd: Starting k3s-agent

k3s2@k3s2:~$ curl -sfL https://get.k3s.io | K3S_URL=https://k3s1.k3s.local:6443 K3S_TOKEN=K100772d3a421be961da31afce5338280032a42ad8a152c683d22a0d2d72040af71::server:5840b68a95f662baf09269b2eceb7ce9 sh -

[sudo] password for k3s2:

[INFO] Finding release for channel stable

[INFO] Using v1.25.6+k3s1 as release

[INFO] Downloading hash https://github.com/k3s-io/k3s/releases/download/v1.25.6+k3s1/sha256sum-amd64.txt

[INFO] Downloading binary https://github.com/k3s-io/k3s/releases/download/v1.25.6+k3s1/k3s

[INFO] Verifying binary download

[INFO] Installing k3s to /usr/local/bin/k3s

[INFO] Skipping installation of SELinux RPM

[INFO] Creating /usr/local/bin/kubectl symlink to k3s

[INFO] Creating /usr/local/bin/crictl symlink to k3s

[INFO] Creating /usr/local/bin/ctr symlink to k3s

[INFO] Creating killall script /usr/local/bin/k3s-killall.sh

[INFO] Creating uninstall script /usr/local/bin/k3s-agent-uninstall.sh

[INFO] env: Creating environment file /etc/systemd/system/k3s-agent.service.env

[INFO] systemd: Creating service file /etc/systemd/system/k3s-agent.service

[INFO] systemd: Enabling k3s-agent unit

Created symlink /etc/systemd/system/multi-user.target.wants/k3s-agent.service → /etc/systemd/system/k3s-agent.service.

[INFO] systemd: Starting k3s-agent

再开一个shell查看进程如下


k3s2@k3s2:~$ ps aux|grep k3s
k3s2        1794  0.0  0.4  19040  9712 ?        Ss   11:25   0:00 /lib/systemd/systemd --user
k3s2        1796  0.0  0.2 105288  4416 ?        S    11:25   0:00 (sd-pam)
k3s2        1801  0.0  0.2   8264  5280 tty1     S+   11:25   0:00 -bash
root        2368  0.0  0.4  13796  8968 ?        Ss   11:29   0:00 sshd: k3s2 [priv]
k3s2        2442  0.0  0.3  13932  6124 ?        S    11:29   0:00 sshd: k3s2@pts/0
k3s2        2443  0.0  0.2   8276  5172 pts/0    Ss   11:29   0:00 -bash
k3s2        3063  0.0  0.0   2608  1904 pts/0    S+   11:53   0:00 sh -
root        3241  0.0  0.2   9264  4656 pts/0    S+   11:54   0:00 sudo systemctl restart k3s-agent
root        3242  0.0  0.1   9276  3760 pts/0    S+   11:54   0:00 systemctl restart k3s-agent
root        3263  6.8  4.3 842952 87268 ?        Ssl  11:54   0:08 /usr/local/bin/k3s agent
root        3328  0.5  0.4  13796  9000 ?        Ss   11:56   0:00 sshd: k3s2 [priv]
k3s2        3416  0.0  0.3  13932  6140 ?        S    11:56   0:00 sshd: k3s2@pts/1
k3s2        3417  1.6  0.2   8276  5100 pts/1    Ss   11:56   0:00 -bash
k3s2        3428  0.0  0.1   8888  3380 pts/1    R+   11:56   0:00 ps aux
k3s2        3429  0.0  0.0   6432   724 pts/1    S+   11:56   0:00 grep --color=auto k3s

k3s2@k3s2:~$ ps aux|grep k3s

k3s2 1794 0.0 0.4 19040 9712 ? Ss 11:25 0:00 /lib/systemd/systemd --user

k3s2 1796 0.0 0.2 105288 4416 ? S 11:25 0:00 (sd-pam)

k3s2 1801 0.0 0.2 8264 5280 tty1 S+ 11:25 0:00 -bash

root 2368 0.0 0.4 13796 8968 ? Ss 11:29 0:00 sshd: k3s2 [priv]

k3s2 2442 0.0 0.3 13932 6124 ? S 11:29 0:00 sshd: k3s2@pts/0

k3s2 2443 0.0 0.2 8276 5172 pts/0 Ss 11:29 0:00 -bash

k3s2 3063 0.0 0.0 2608 1904 pts/0 S+ 11:53 0:00 sh -

root 3241 0.0 0.2 9264 4656 pts/0 S+ 11:54 0:00 sudo systemctl restart k3s-agent

root 3242 0.0 0.1 9276 3760 pts/0 S+ 11:54 0:00 systemctl restart k3s-agent

root 3263 6.8 4.3 842952 87268 ? Ssl 11:54 0:08 /usr/local/bin/k3s agent

root 3328 0.5 0.4 13796 9000 ? Ss 11:56 0:00 sshd: k3s2 [priv]

k3s2 3416 0.0 0.3 13932 6140 ? S 11:56 0:00 sshd: k3s2@pts/1

k3s2 3417 1.6 0.2 8276 5100 pts/1 Ss 11:56 0:00 -bash

k3s2 3428 0.0 0.1 8888 3380 pts/1 R+ 11:56 0:00 ps aux

k3s2 3429 0.0 0.0 6432 724 pts/1 S+ 11:56 0:00 grep --color=auto k3s

根据systemd服务注册的命令/usr/local/bin/k3s agent，可以看到大概率是执行systemctl restart k3s-agent卡住的


k3s2@k3s2:~$ cat /etc/systemd/system/k3s-agent.service
[Unit]
Description=Lightweight Kubernetes
Documentation=https://k3s.io
Wants=network-online.target
After=network-online.target

[Install]
WantedBy=multi-user.target

[Service]
Type=notify
EnvironmentFile=-/etc/default/%N
EnvironmentFile=-/etc/sysconfig/%N
EnvironmentFile=-/etc/systemd/system/k3s-agent.service.env
KillMode=process
Delegate=yes
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=1048576
LimitNPROC=infinity
LimitCORE=infinity
TasksMax=infinity
TimeoutStartSec=0
Restart=always
RestartSec=5s
ExecStartPre=/bin/sh -xc '! /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service'
ExecStartPre=-/sbin/modprobe br_netfilter
ExecStartPre=-/sbin/modprobe overlay
ExecStart=/usr/local/bin/k3s \
    agent \

k3s2@k3s2:~$ cat /etc/systemd/system/k3s-agent.service

[Unit]

Description=Lightweight Kubernetes

Documentation=https://k3s.io

Wants=network-online.target

After=network-online.target

[Install]

WantedBy=multi-user.target

[Service]

Type=notify

EnvironmentFile=-/etc/default/%N

EnvironmentFile=-/etc/sysconfig/%N

EnvironmentFile=-/etc/systemd/system/k3s-agent.service.env

KillMode=process

Delegate=yes

# Having non-zero Limit*s causes performance problems due to accounting overhead

# in the kernel. We recommend using cgroups to do container-local accounting.

LimitNOFILE=1048576

LimitNPROC=infinity

LimitCORE=infinity

TasksMax=infinity

TimeoutStartSec=0

Restart=always

RestartSec=5s

ExecStartPre=/bin/sh -xc '! /usr/bin/systemctl is-enabled --quiet nm-cloud-setup.service'

ExecStartPre=-/sbin/modprobe br_netfilter

ExecStartPre=-/sbin/modprobe overlay

ExecStart=/usr/local/bin/k3s \

agent \

~~token本身错的可能性不大，所以大概率是K3S_URL的问题，因为我用了本地的DNS，所以写的是域名。尝试配置下HOSTS试试~~

保险起见我去 /var/lib/rancher/k3s/agent/containerd/containerd.log看了下，居然还在执行东西。。。难道只是单纯的慢？这时候主节点已经能看到agent了，但ROLES里是none让我比较纠结是不是正常


k3s1@k3s1:~$ sudo kubectl get nodes
NAME   STATUS   ROLES                  AGE    VERSION
k3s1   Ready    control-plane,master   37m    v1.25.6+k3s1
k3s2   Ready    <none>                 5m8s   v1.25.6+k3s1

k3s1@k3s1:~$ sudo kubectl get nodes

NAME STATUS ROLES AGE VERSION

k3s1 Ready control-plane,master 37m v1.25.6+k3s1

k3s2 Ready <none> 5m8s v1.25.6+k3s1

根据命令行参数打印更加详细的节点信息如下，这样看起来worker工作是正常的


k3s1@k3s1:~$ sudo kubectl get nodes -o wide  --show-labels=true
NAME   STATUS   ROLES                  AGE   VERSION        INTERNAL-IP     EXTERNAL-IP   OS-IMAGE             KERNEL-VERSION      CONTAINER-RUNTIME          LABELS
k3s1   Ready    control-plane,master   44m   v1.25.6+k3s1   192.168.2.227   <none>        Ubuntu 20.04.5 LTS   5.4.0-125-generic   containerd://1.6.15-k3s1   beta.kubernetes.io/arch=amd64,beta.kubernetes.io/instance-type=k3s,beta.kubernetes.io/os=linux,egress.k3s.io/cluster=true,kubernetes.io/arch=amd64,kubernetes.io/hostname=k3s1,kubernetes.io/os=linux,node-role.kubernetes.io/control-plane=true,node-role.kubernetes.io/master=true,node.kubernetes.io/instance-type=k3s
k3s2   Ready    <none>                 12m   v1.25.6+k3s1   192.168.2.176   <none>        Ubuntu 20.04.5 LTS   5.4.0-125-generic   containerd://1.6.15-k3s1   beta.kubernetes.io/arch=amd64,beta.kubernetes.io/instance-type=k3s,beta.kubernetes.io/os=linux,egress.k3s.io/cluster=true,kubernetes.io/arch=amd64,kubernetes.io/hostname=k3s2,kubernetes.io/os=linux,node.kubernetes.io/instance-type=k3s

k3s1@k3s1:~$ sudo kubectl get nodes -o wide --show-labels=true

NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME LABELS

k3s1 Ready control-plane,master 44m v1.25.6+k3s1 192.168.2.227 <none> Ubuntu 20.04.5 LTS 5.4.0-125-generic containerd://1.6.15-k3s1 beta.kubernetes.io/arch=amd64,beta.kubernetes.io/instance-type=k3s,beta.kubernetes.io/os=linux,egress.k3s.io/cluster=true,kubernetes.io/arch=amd64,kubernetes.io/hostname=k3s1,kubernetes.io/os=linux,node-role.kubernetes.io/control-plane=true,node-role.kubernetes.io/master=true,node.kubernetes.io/instance-type=k3s

k3s2 Ready <none> 12m v1.25.6+k3s1 192.168.2.176 <none> Ubuntu 20.04.5 LTS 5.4.0-125-generic containerd://1.6.15-k3s1 beta.kubernetes.io/arch=amd64,beta.kubernetes.io/instance-type=k3s,beta.kubernetes.io/os=linux,egress.k3s.io/cluster=true,kubernetes.io/arch=amd64,kubernetes.io/hostname=k3s2,kubernetes.io/os=linux,node.kubernetes.io/instance-type=k3s

测试

尝试构建一个服务是否能正常运行，从k8s官网看看能不能扒一个现成的yaml测试


k3s1@k3s1:~$ sudo  kubectl version
WARNING: This version information is deprecated and will be replaced with the output from kubectl version --short.  Use --output=yaml|json to get the full version.
Client Version: version.Info{Major:"1", Minor:"25", GitVersion:"v1.25.6+k3s1", GitCommit:"9176e03c5788e467420376d10a1da2b6de6ff31f", GitTreeState:"clean", BuildDate:"2023-01-26T00:47:47Z", GoVersion:"go1.19.5", Compiler:"gc", Platform:"linux/amd64"}
Kustomize Version: v4.5.7
Server Version: version.Info{Major:"1", Minor:"25", GitVersion:"v1.25.6+k3s1", GitCommit:"9176e03c5788e467420376d10a1da2b6de6ff31f", GitTreeState:"clean", BuildDate:"2023-01-26T00:47:47Z", GoVersion:"go1.19.5", Compiler:"gc", Platform:"linux/amd64"}

k3s1@k3s1:~$ sudo kubectl version

WARNING: This version information is deprecated and will be replaced with the output from kubectl version --short. Use --output=yaml|json to get the full version.

Client Version: version.Info{Major:"1", Minor:"25", GitVersion:"v1.25.6+k3s1", GitCommit:"9176e03c5788e467420376d10a1da2b6de6ff31f", GitTreeState:"clean", BuildDate:"2023-01-26T00:47:47Z", GoVersion:"go1.19.5", Compiler:"gc", Platform:"linux/amd64"}

Kustomize Version: v4.5.7

Server Version: version.Info{Major:"1", Minor:"25", GitVersion:"v1.25.6+k3s1", GitCommit:"9176e03c5788e467420376d10a1da2b6de6ff31f", GitTreeState:"clean", BuildDate:"2023-01-26T00:47:47Z", GoVersion:"go1.19.5", Compiler:"gc", Platform:"linux/amd64"}

尝试创建DEMO


k3s1@k3s1:~$ sudo kubectl get deployments
No resources found in default namespace.
k3s1@k3s1:~$ sudo kubectl create deployment kubernetes-bootcamp --image=gcr.io/google-samples/kubernetes-bootcamp:v1
deployment.apps/kubernetes-bootcamp created
k3s1@k3s1:~$ sudo kubectl get deployments
NAME                  READY   UP-TO-DATE   AVAILABLE   AGE
kubernetes-bootcamp   0/1     1            0           4s

k3s1@k3s1:~$ sudo kubectl get deployments
NAME                  READY   UP-TO-DATE   AVAILABLE   AGE
kubernetes-bootcamp   1/1     1            1           44s

k3s1@k3s1:~$ sudo kubectl get pods
NAME                                   READY   STATUS    RESTARTS   AGE
kubernetes-bootcamp-75c5d958ff-dzdkw   1/1     Running   0          3m23s

k3s1@k3s1:~$ sudo kubectl describe pods
Name:             kubernetes-bootcamp-75c5d958ff-dzdkw
Namespace:        default
Priority:         0
Service Account:  default
Node:             k3s2/192.168.2.176
Start Time:       Sat, 04 Feb 2023 12:23:03 +0000
Labels:           app=kubernetes-bootcamp
                  pod-template-hash=75c5d958ff
Annotations:      <none>
Status:           Running
IP:               10.42.1.3
IPs:
  IP:           10.42.1.3
Controlled By:  ReplicaSet/kubernetes-bootcamp-75c5d958ff
Containers:
  kubernetes-bootcamp:
    Container ID:   containerd://871938aef1c0923d784e32020801861b78b2dfb7d7a317423965e002826b4af9
    Image:          gcr.io/google-samples/kubernetes-bootcamp:v1
    Image ID:       gcr.io/google-samples/kubernetes-bootcamp@sha256:0d6b8ee63bb57c5f5b6156f446b3bc3b3c143d233037f3a2f00e279c8fcc64af
    Port:           <none>
    Host Port:      <none>
    State:          Running
      Started:      Sat, 04 Feb 2023 12:23:46 +0000
    Ready:          True
    Restart Count:  0
    Environment:    <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-r2mwg (ro)
Conditions:
  Type              Status
  Initialized       True
  Ready             True
  ContainersReady   True
  PodScheduled      True
Volumes:
  kube-api-access-r2mwg:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type    Reason     Age    From               Message
  ----    ------     ----   ----               -------
  Normal  Scheduled  4m23s  default-scheduler  Successfully assigned default/kubernetes-bootcamp-75c5d958ff-dzdkw to k3s2
  Normal  Pulling    4m22s  kubelet            Pulling image "gcr.io/google-samples/kubernetes-bootcamp:v1"
  Normal  Pulled     3m40s  kubelet            Successfully pulled image "gcr.io/google-samples/kubernetes-bootcamp:v1" in 41.916860932s (41.916911292s including waiting)
  Normal  Created    3m40s  kubelet            Created container kubernetes-bootcamp
  Normal  Started    3m40s  kubelet            Started container kubernetes-bootcamp


k3s1@k3s1:~$ sudo kubectl describe pods kubernetes-bootcamp-75c5d958ff-dzdkw
Name:             kubernetes-bootcamp-75c5d958ff-dzdkw
Namespace:        default
Priority:         0
Service Account:  default
Node:             k3s2/192.168.2.176
Start Time:       Sat, 04 Feb 2023 12:23:03 +0000
Labels:           app=kubernetes-bootcamp
                  pod-template-hash=75c5d958ff
Annotations:      <none>
Status:           Running
IP:               10.42.1.3
IPs:
  IP:           10.42.1.3
Controlled By:  ReplicaSet/kubernetes-bootcamp-75c5d958ff
Containers:
  kubernetes-bootcamp:
    Container ID:   containerd://871938aef1c0923d784e32020801861b78b2dfb7d7a317423965e002826b4af9
    Image:          gcr.io/google-samples/kubernetes-bootcamp:v1
    Image ID:       gcr.io/google-samples/kubernetes-bootcamp@sha256:0d6b8ee63bb57c5f5b6156f446b3bc3b3c143d233037f3a2f00e279c8fcc64af
    Port:           <none>
    Host Port:      <none>
    State:          Running
      Started:      Sat, 04 Feb 2023 12:23:46 +0000
    Ready:          True
    Restart Count:  0
    Environment:    <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-r2mwg (ro)
Conditions:
  Type              Status
  Initialized       True
  Ready             True
  ContainersReady   True
  PodScheduled      True
Volumes:
  kube-api-access-r2mwg:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type    Reason     Age    From               Message
  ----    ------     ----   ----               -------
  Normal  Scheduled  5m28s  default-scheduler  Successfully assigned default/kubernetes-bootcamp-75c5d958ff-dzdkw to k3s2
  Normal  Pulling    5m28s  kubelet            Pulling image "gcr.io/google-samples/kubernetes-bootcamp:v1"
  Normal  Pulled     4m46s  kubelet            Successfully pulled image "gcr.io/google-samples/kubernetes-bootcamp:v1" in 41.916860932s (41.916911292s including waiting)
  Normal  Created    4m46s  kubelet            Created container kubernetes-bootcamp
  Normal  Started    4m46s  kubelet            Started container kubernetes-bootcamp

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

k3s1@k3s1:~$ sudo kubectl get deployments

No resources found in default namespace.

k3s1@k3s1:~$ sudo kubectl create deployment kubernetes-bootcamp --image=gcr.io/google-samples/kubernetes-bootcamp:v1

deployment.apps/kubernetes-bootcamp created

k3s1@k3s1:~$ sudo kubectl get deployments

NAME READY UP-TO-DATE AVAILABLE AGE

kubernetes-bootcamp 0/1 1 0 4s

k3s1@k3s1:~$ sudo kubectl get deployments

NAME READY UP-TO-DATE AVAILABLE AGE

kubernetes-bootcamp 1/1 1 1 44s

k3s1@k3s1:~$ sudo kubectl get pods

NAME READY STATUS RESTARTS AGE

kubernetes-bootcamp-75c5d958ff-dzdkw 1/1 Running 0 3m23s

k3s1@k3s1:~$ sudo kubectl describe pods

Name: kubernetes-bootcamp-75c5d958ff-dzdkw

Namespace: default

Priority: 0

Service Account: default

Node: k3s2/192.168.2.176

Start Time: Sat, 04 Feb 2023 12:23:03 +0000

Labels: app=kubernetes-bootcamp

pod-template-hash=75c5d958ff

Annotations: <none>

Status: Running

IP: 10.42.1.3

IPs:

IP: 10.42.1.3

Controlled By: ReplicaSet/kubernetes-bootcamp-75c5d958ff

Containers:

kubernetes-bootcamp:

Container ID: containerd://871938aef1c0923d784e32020801861b78b2dfb7d7a317423965e002826b4af9

Image: gcr.io/google-samples/kubernetes-bootcamp:v1

Image ID: gcr.io/google-samples/kubernetes-bootcamp@sha256:0d6b8ee63bb57c5f5b6156f446b3bc3b3c143d233037f3a2f00e279c8fcc64af

Port: <none>

Host Port: <none>

State: Running

Started: Sat, 04 Feb 2023 12:23:46 +0000

Ready: True

Restart Count: 0

Environment: <none>

Mounts:

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-r2mwg (ro)

Conditions:

Type Status

Initialized True

Ready True

ContainersReady True

PodScheduled True

Volumes:

kube-api-access-r2mwg:

Type: Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds: 3607

ConfigMapName: kube-root-ca.crt

ConfigMapOptional: <nil>

DownwardAPI: true

QoS Class: BestEffort

Node-Selectors: <none>

Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

Events:

Type Reason Age From Message

---- ------ ---- ---- -------

Normal Scheduled 4m23s default-scheduler Successfully assigned default/kubernetes-bootcamp-75c5d958ff-dzdkw to k3s2

Normal Pulling 4m22s kubelet Pulling image "gcr.io/google-samples/kubernetes-bootcamp:v1"

Normal Pulled 3m40s kubelet Successfully pulled image "gcr.io/google-samples/kubernetes-bootcamp:v1" in 41.916860932s (41.916911292s including waiting)

Normal Created 3m40s kubelet Created container kubernetes-bootcamp

Normal Started 3m40s kubelet Started container kubernetes-bootcamp

k3s1@k3s1:~$ sudo kubectl describe pods kubernetes-bootcamp-75c5d958ff-dzdkw

Name: kubernetes-bootcamp-75c5d958ff-dzdkw

Namespace: default

Priority: 0

Service Account: default

Node: k3s2/192.168.2.176

Start Time: Sat, 04 Feb 2023 12:23:03 +0000

Labels: app=kubernetes-bootcamp

pod-template-hash=75c5d958ff

Annotations: <none>

Status: Running

IP: 10.42.1.3

IPs:

IP: 10.42.1.3

Controlled By: ReplicaSet/kubernetes-bootcamp-75c5d958ff

Containers:

kubernetes-bootcamp:

Container ID: containerd://871938aef1c0923d784e32020801861b78b2dfb7d7a317423965e002826b4af9

Image: gcr.io/google-samples/kubernetes-bootcamp:v1

Image ID: gcr.io/google-samples/kubernetes-bootcamp@sha256:0d6b8ee63bb57c5f5b6156f446b3bc3b3c143d233037f3a2f00e279c8fcc64af

Port: <none>

Host Port: <none>

State: Running

Started: Sat, 04 Feb 2023 12:23:46 +0000

Ready: True

Restart Count: 0

Environment: <none>

Mounts:

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-r2mwg (ro)

Conditions:

Type Status

Initialized True

Ready True

ContainersReady True

PodScheduled True

Volumes:

kube-api-access-r2mwg:

Type: Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds: 3607

ConfigMapName: kube-root-ca.crt

ConfigMapOptional: <nil>

DownwardAPI: true

QoS Class: BestEffort

Node-Selectors: <none>

Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

Events:

Type Reason Age From Message

---- ------ ---- ---- -------

Normal Scheduled 5m28s default-scheduler Successfully assigned default/kubernetes-bootcamp-75c5d958ff-dzdkw to k3s2

Normal Pulling 5m28s kubelet Pulling image "gcr.io/google-samples/kubernetes-bootcamp:v1"

Normal Pulled 4m46s kubelet Successfully pulled image "gcr.io/google-samples/kubernetes-bootcamp:v1" in 41.916860932s (41.916911292s including waiting)

Normal Created 4m46s kubelet Created container kubernetes-bootcamp

Normal Started 4m46s kubelet Started container kubernetes-bootcamp

尝试使用 kubectl exec进入容器


k3s1@k3s1:~$ sudo kubectl exec -it kubernetes-bootcamp-75c5d958ff-dzdkw bash
kubectl exec [POD] [COMMAND] is DEPRECATED and will be removed in a future version. Use kubectl exec [POD] -- [COMMAND] instead.

root@kubernetes-bootcamp-75c5d958ff-dzdkw:/# cat server.js
var http = require('http');
var requests=0;
var podname= process.env.HOSTNAME;
var startTime;
var host;
var handleRequest = function(request, response) {
  response.setHeader('Content-Type', 'text/plain');
  response.writeHead(200);
  response.write("Hello Kubernetes bootcamp! | Running on: ");
  response.write(host);
  response.end(" | v=1\n");
  console.log("Running On:" ,host, "| Total Requests:", ++requests,"| App Uptime:", (new Date() - startTime)/1000 , "seconds", "| Log Time:",new Date());
}
var www = http.createServer(handleRequest);
www.listen(8080,function () {
    startTime = new Date();;
    host = process.env.HOSTNAME;
    console.log ("Kubernetes Bootcamp App Started At:",startTime, "| Running On: " ,host, "\n" );
});

k3s1@k3s1:~$ sudo kubectl exec -it kubernetes-bootcamp-75c5d958ff-dzdkw bash

kubectl exec [POD] [COMMAND] is DEPRECATED and will be removed in a future version. Use kubectl exec [POD] -- [COMMAND] instead.

root@kubernetes-bootcamp-75c5d958ff-dzdkw:/# cat server.js

var http = require('http');

var requests=0;

var podname= process.env.HOSTNAME;

var startTime;

var host;

var handleRequest = function(request, response) {

response.setHeader('Content-Type', 'text/plain');

response.writeHead(200);

response.write("Hello Kubernetes bootcamp! | Running on: ");

response.write(host);

response.end(" | v=1\n");

console.log("Running On:" ,host, "| Total Requests:", ++requests,"| App Uptime:", (new Date() - startTime)/1000 , "seconds", "| Log Time:",new Date());

}

var www = http.createServer(handleRequest);

www.listen(8080,function () {

startTime = new Date();;

host = process.env.HOSTNAME;

console.log ("Kubernetes Bootcamp App Started At:",startTime, "| Running On: " ,host, "\n" );

});

总结

相比多年前的印象，现在的k8s可以借助k3s这个青春版快速的启动一个集群，是时候更新下这个错误认知了，现在启动一个k8s测试用是相当简便并且成本很低的。下次尝试原版k8s，成功后尝试kubekey这个类似ansible一样的自动化安装工具

参考

https://docs.k3s.io/architecture

https://www.suse.com/suse-rancher/support-matrix/all-supported-versions/rancher-v2-7-1/

资源分配和实际占用统计 https://docs.k3s.io/reference/resource-profiling

自动化安装 https://kubesphere.io/zh/docs/v3.3/installing-on-linux/introduction/kubekey/

ROLES https://blog.csdn.net/Lingoesforstudy/article/details/116484624

https://kubernetes.io/zh-cn/docs/tutorials/kubernetes-basics/deploy-app/deploy-intro/

https://blog.csdn.net/qq_44246980/article/details/120143353

20221217mongodb集群搭建

视频版

https://www.bilibili.com/video/BV1Lv4y1Q7xe/

环境准备

按https://www.mongodb.com/docs/manual/administration/production-notes/#std-label-prod-notes-supported-platforms 所说6.0支持20.04和18.04

没说22.04支持，保险起见按文档准备系统版本

至少3个以上的奇数节点，5.0以上必须使用域名配置，节点间端口27017网络要求互通


IP1 mongodb0.example.net
IP2 mongodb1.example.net
IP3 mongodb2.example.net
IP1 test.w.mongo.db
IP2 test.r.mongo.db
IP3 test.r.mongo.db

IP1 mongodb0.example.net

IP2 mongodb1.example.net

IP3 mongodb2.example.net

IP1 test.w.mongo.db

IP2 test.r.mongo.db

IP3 test.r.mongo.db

1.安装


wget -qO - https://www.mongodb.org/static/pgp/server-6.0.asc | sudo apt-key add -
sudo touch /etc/apt/sources.list.d/mongodb-org-6.0.list
echo "deb [ arch=amd64,arm64 ] https://repo.mongodb.org/apt/ubuntu focal/mongodb-org/6.0 multiverse" | sudo tee /etc/apt/sources.list.d/mongodb-org-6.0.list
sudo apt-get update
sudo apt-get install -y mongodb-org

wget -qO - https://www.mongodb.org/static/pgp/server-6.0.asc | sudo apt-key add -

sudo touch /etc/apt/sources.list.d/mongodb-org-6.0.list

echo "deb [ arch=amd64,arm64 ] https://repo.mongodb.org/apt/ubuntu focal/mongodb-org/6.0 multiverse" | sudo tee /etc/apt/sources.list.d/mongodb-org-6.0.list

sudo apt-get update

sudo apt-get install -y mongodb-org

常见目录


数据 /var/lib/mongodb 
日志 /var/log/mongodb
配置 /etc/mongod.conf

数据 /var/lib/mongodb

日志 /var/log/mongodb

配置 /etc/mongod.conf

常用命令


sudo systemctl start mongod
sudo systemctl stop mongod
sudo systemctl restart mongod
sudo systemctl status mongod
mongosh

sudo systemctl start mongod

sudo systemctl stop mongod

sudo systemctl restart mongod

sudo systemctl status mongod

mongosh

2.集群配置

MongoDB 的复制集是由一组保持相同数据集的 mongod 进程组成的。复制集提供了冗余和高可用的能力，同时它是所有生产环境部署的基础

在特定情况下可以提高读取性能，因为客户端可以把读取请求发送给不同的服务器。被复制多份数据可以用于灾备或审计

复制集包含几个 data bearing nodes和可选的一个arbiter node。在data bearing nodes上有且仅有一个成员是主节点，主节点接收所有写请求操作，一个主节点会使用 { w: "majority" } 来标识

设置bindIp启用远程访问，生产环境注意提前设置密码和防火墙

https://www.mongodb.com/docs/manual/reference/configuration-options/#mongodb-setting-net.bindIp

配置集群名

https://www.mongodb.com/docs/manual/reference/configuration-options/#mongodb-setting-replication.replSetName


mongosh
#初始化集群配置
rs.initiate( {
   _id : "rs0",
   members: [
      { _id: 0, host: "mongodb0.example.net:27017" },
      { _id: 1, host: "mongodb1.example.net:27017" },
      { _id: 2, host: "mongodb2.example.net:27017" }
   ]
})

test> rs.initiate( {
...    _id : "rs0",
...    members: [
...       { _id: 0, host: "test1.mongo.db:27017" },
...       { _id: 1, host: "test2.mongo.db:27017" },
...       { _id: 2, host: "test3.mongo.db:27017" }
...    ]
... })
{ ok: 1 }
rs0 [direct: other] test>

#查看集群配置
rs.conf()

rs0 [direct: other] test> rs.conf()
{
  _id: 'rs0',
  version: 1,
  term: 1,
  members: [
    {
      _id: 0,
      host: 'test1.mongo.db:27017',
      arbiterOnly: false,
      buildIndexes: true,
      hidden: false,
      priority: 1,
      tags: {},
      secondaryDelaySecs: Long("0"),
      votes: 1
    },
    {
      _id: 1,
      host: 'test2.mongo.db:27017',
      arbiterOnly: false,
      buildIndexes: true,
      hidden: false,
      priority: 1,
      tags: {},
      secondaryDelaySecs: Long("0"),
      votes: 1
    },
    {
      _id: 2,
      host: 'test3.mongo.db:27017',
      arbiterOnly: false,
      buildIndexes: true,
      hidden: false,
      priority: 1,
      tags: {},
      secondaryDelaySecs: Long("0"),
      votes: 1
    }
  ],
  protocolVersion: Long("1"),
  writeConcernMajorityJournalDefault: true,
  settings: {
    chainingAllowed: true,
    heartbeatIntervalMillis: 2000,
    heartbeatTimeoutSecs: 10,
    electionTimeoutMillis: 10000,
    catchUpTimeoutMillis: -1,
    catchUpTakeoverDelayMillis: 30000,
    getLastErrorModes: {},
    getLastErrorDefaults: { w: 1, wtimeout: 0 },
    replicaSetId: ObjectId("639db0b39d9a0c1c17cfaf5a")
  }
}
rs0 [direct: primary] test>


#查看主节点
rs.status()


rs0 [direct: primary] test> rs.status()
{
  set: 'rs0',
  date: ISODate("2022-12-17T12:06:57.005Z"),
  myState: 1,
  term: Long("1"),
  syncSourceHost: '',
  syncSourceId: -1,
  heartbeatIntervalMillis: Long("2000"),
  majorityVoteCount: 2,
  writeMajorityCount: 2,
  votingMembersCount: 3,
  writableVotingMembersCount: 3,
  optimes: {
    lastCommittedOpTime: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },
    lastCommittedWallTime: ISODate("2022-12-17T12:06:52.885Z"),
    readConcernMajorityOpTime: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },
    appliedOpTime: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },
    durableOpTime: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },
    lastAppliedWallTime: ISODate("2022-12-17T12:06:52.885Z"),
    lastDurableWallTime: ISODate("2022-12-17T12:06:52.885Z")
  },
  lastStableRecoveryTimestamp: Timestamp({ t: 1671278771, i: 1 }),
  electionCandidateMetrics: {
    lastElectionReason: 'electionTimeout',
    lastElectionDate: ISODate("2022-12-17T12:06:22.806Z"),
    electionTerm: Long("1"),
    lastCommittedOpTimeAtElection: { ts: Timestamp({ t: 1671278771, i: 1 }), t: Long("-1") },
    lastSeenOpTimeAtElection: { ts: Timestamp({ t: 1671278771, i: 1 }), t: Long("-1") },
    numVotesNeeded: 2,
    priorityAtElection: 1,
    electionTimeoutMillis: Long("10000"),
    numCatchUpOps: Long("0"),
    newTermStartDate: ISODate("2022-12-17T12:06:22.864Z"),
    wMajorityWriteAvailabilityDate: ISODate("2022-12-17T12:06:23.645Z")
  },
  members: [
    {
      _id: 0,
      name: 'test1.mongo.db:27017',
      health: 1,
      state: 1,
      stateStr: 'PRIMARY',
      uptime: 142,
      optime: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },
      optimeDate: ISODate("2022-12-17T12:06:52.000Z"),
      lastAppliedWallTime: ISODate("2022-12-17T12:06:52.885Z"),
      lastDurableWallTime: ISODate("2022-12-17T12:06:52.885Z"),
      syncSourceHost: '',
      syncSourceId: -1,
      infoMessage: '',
      electionTime: Timestamp({ t: 1671278782, i: 1 }),
      electionDate: ISODate("2022-12-17T12:06:22.000Z"),
      configVersion: 1,
      configTerm: 1,
      self: true,
      lastHeartbeatMessage: ''
    },
    {
      _id: 1,
      name: 'test2.mongo.db:27017',
      health: 1,
      state: 2,
      stateStr: 'SECONDARY',
      uptime: 45,
      optime: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },
      optimeDurable: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },
      optimeDate: ISODate("2022-12-17T12:06:52.000Z"),
      optimeDurableDate: ISODate("2022-12-17T12:06:52.000Z"),
      lastAppliedWallTime: ISODate("2022-12-17T12:06:52.885Z"),
      lastDurableWallTime: ISODate("2022-12-17T12:06:52.885Z"),
      lastHeartbeat: ISODate("2022-12-17T12:06:56.857Z"),
      lastHeartbeatRecv: ISODate("2022-12-17T12:06:55.864Z"),
      pingMs: Long("0"),
      lastHeartbeatMessage: '',
      syncSourceHost: 'test1.mongo.db:27017',
      syncSourceId: 0,
      infoMessage: '',
      configVersion: 1,
      configTerm: 1
    },
    {
      _id: 2,
      name: 'test3.mongo.db:27017',
      health: 1,
      state: 2,
      stateStr: 'SECONDARY',
      uptime: 45,
      optime: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },
      optimeDurable: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },
      optimeDate: ISODate("2022-12-17T12:06:52.000Z"),
      optimeDurableDate: ISODate("2022-12-17T12:06:52.000Z"),
      lastAppliedWallTime: ISODate("2022-12-17T12:06:52.885Z"),
      lastDurableWallTime: ISODate("2022-12-17T12:06:52.885Z"),
      lastHeartbeat: ISODate("2022-12-17T12:06:56.857Z"),
      lastHeartbeatRecv: ISODate("2022-12-17T12:06:55.860Z"),
      pingMs: Long("0"),
      lastHeartbeatMessage: '',
      syncSourceHost: 'test1.mongo.db:27017',
      syncSourceId: 0,
      infoMessage: '',
      configVersion: 1,
      configTerm: 1
    }
  ],
  ok: 1,
  '$clusterTime': {
    clusterTime: Timestamp({ t: 1671278812, i: 1 }),
    signature: {
      hash: Binary(Buffer.from("0000000000000000000000000000000000000000", "hex"), 0),
      keyId: Long("0")
    }
  },
  operationTime: Timestamp({ t: 1671278812, i: 1 })
}

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

141

142

143

144

145

146

147

148

149

150

151

152

153

154

155

156

157

158

159

160

161

162

163

164

165

166

167

168

169

170

171

172

173

174

175

176

177

178

179

180

181

182

183

184

185

186

187

188

189

190

191

192

193

194

195

196

197

198

199

200

201

mongosh

#初始化集群配置

rs.initiate( {

_id : "rs0",

members: [

{ _id: 0, host: "mongodb0.example.net:27017" },

{ _id: 1, host: "mongodb1.example.net:27017" },

{ _id: 2, host: "mongodb2.example.net:27017" }

]

})

test> rs.initiate( {

... _id : "rs0",

... members: [

... { _id: 0, host: "test1.mongo.db:27017" },

... { _id: 1, host: "test2.mongo.db:27017" },

... { _id: 2, host: "test3.mongo.db:27017" }

... ]

... })

{ ok: 1 }

rs0 [direct: other] test>

#查看集群配置

rs.conf()

rs0 [direct: other] test> rs.conf()

{

_id: 'rs0',

version: 1,

term: 1,

members: [

{

_id: 0,

host: 'test1.mongo.db:27017',

arbiterOnly: false,

buildIndexes: true,

hidden: false,

priority: 1,

tags: {},

secondaryDelaySecs: Long("0"),

votes: 1

{

_id: 1,

host: 'test2.mongo.db:27017',

arbiterOnly: false,

buildIndexes: true,

hidden: false,

priority: 1,

tags: {},

secondaryDelaySecs: Long("0"),

votes: 1

{

_id: 2,

host: 'test3.mongo.db:27017',

arbiterOnly: false,

buildIndexes: true,

hidden: false,

priority: 1,

tags: {},

secondaryDelaySecs: Long("0"),

votes: 1

}

protocolVersion: Long("1"),

writeConcernMajorityJournalDefault: true,

settings: {

chainingAllowed: true,

heartbeatIntervalMillis: 2000,

heartbeatTimeoutSecs: 10,

electionTimeoutMillis: 10000,

catchUpTimeoutMillis: -1,

catchUpTakeoverDelayMillis: 30000,

getLastErrorModes: {},

getLastErrorDefaults: { w: 1, wtimeout: 0 },

replicaSetId: ObjectId("639db0b39d9a0c1c17cfaf5a")

}

rs0 [direct: primary] test>

#查看主节点

rs.status()

rs0 [direct: primary] test> rs.status()

{

set: 'rs0',

date: ISODate("2022-12-17T12:06:57.005Z"),

myState: 1,

term: Long("1"),

syncSourceHost: '',

syncSourceId: -1,

heartbeatIntervalMillis: Long("2000"),

majorityVoteCount: 2,

writeMajorityCount: 2,

votingMembersCount: 3,

writableVotingMembersCount: 3,

optimes: {

lastCommittedOpTime: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },

lastCommittedWallTime: ISODate("2022-12-17T12:06:52.885Z"),

readConcernMajorityOpTime: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },

appliedOpTime: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },

durableOpTime: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },

lastAppliedWallTime: ISODate("2022-12-17T12:06:52.885Z"),

lastDurableWallTime: ISODate("2022-12-17T12:06:52.885Z")

lastStableRecoveryTimestamp: Timestamp({ t: 1671278771, i: 1 }),

electionCandidateMetrics: {

lastElectionReason: 'electionTimeout',

lastElectionDate: ISODate("2022-12-17T12:06:22.806Z"),

electionTerm: Long("1"),

lastCommittedOpTimeAtElection: { ts: Timestamp({ t: 1671278771, i: 1 }), t: Long("-1") },

lastSeenOpTimeAtElection: { ts: Timestamp({ t: 1671278771, i: 1 }), t: Long("-1") },

numVotesNeeded: 2,

priorityAtElection: 1,

electionTimeoutMillis: Long("10000"),

numCatchUpOps: Long("0"),

newTermStartDate: ISODate("2022-12-17T12:06:22.864Z"),

wMajorityWriteAvailabilityDate: ISODate("2022-12-17T12:06:23.645Z")

members: [

{

_id: 0,

health: 1,

state: 1,

stateStr: 'PRIMARY',

uptime: 142,

optime: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },

optimeDate: ISODate("2022-12-17T12:06:52.000Z"),

lastAppliedWallTime: ISODate("2022-12-17T12:06:52.885Z"),

lastDurableWallTime: ISODate("2022-12-17T12:06:52.885Z"),

syncSourceHost: '',

syncSourceId: -1,

infoMessage: '',

electionTime: Timestamp({ t: 1671278782, i: 1 }),

electionDate: ISODate("2022-12-17T12:06:22.000Z"),

configVersion: 1,

configTerm: 1,

self: true,

lastHeartbeatMessage: ''

{

_id: 1,

health: 1,

state: 2,

stateStr: 'SECONDARY',

uptime: 45,

optime: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },

optimeDurable: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },

optimeDate: ISODate("2022-12-17T12:06:52.000Z"),

optimeDurableDate: ISODate("2022-12-17T12:06:52.000Z"),

lastAppliedWallTime: ISODate("2022-12-17T12:06:52.885Z"),

lastDurableWallTime: ISODate("2022-12-17T12:06:52.885Z"),

lastHeartbeat: ISODate("2022-12-17T12:06:56.857Z"),

lastHeartbeatRecv: ISODate("2022-12-17T12:06:55.864Z"),

pingMs: Long("0"),

lastHeartbeatMessage: '',

syncSourceHost: 'test1.mongo.db:27017',

syncSourceId: 0,

infoMessage: '',

configVersion: 1,

configTerm: 1

{

_id: 2,

health: 1,

state: 2,

stateStr: 'SECONDARY',

uptime: 45,

optime: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },

optimeDurable: { ts: Timestamp({ t: 1671278812, i: 1 }), t: Long("1") },

optimeDate: ISODate("2022-12-17T12:06:52.000Z"),

optimeDurableDate: ISODate("2022-12-17T12:06:52.000Z"),

lastAppliedWallTime: ISODate("2022-12-17T12:06:52.885Z"),

lastDurableWallTime: ISODate("2022-12-17T12:06:52.885Z"),

lastHeartbeat: ISODate("2022-12-17T12:06:56.857Z"),

lastHeartbeatRecv: ISODate("2022-12-17T12:06:55.860Z"),

pingMs: Long("0"),

lastHeartbeatMessage: '',

syncSourceHost: 'test1.mongo.db:27017',

syncSourceId: 0,

infoMessage: '',

configVersion: 1,

configTerm: 1

}

ok: 1,

'$clusterTime': {

clusterTime: Timestamp({ t: 1671278812, i: 1 }),

signature: {

hash: Binary(Buffer.from("0000000000000000000000000000000000000000", "hex"), 0),

keyId: Long("0")

}

operationTime: Timestamp({ t: 1671278812, i: 1 })

}

3.灾备测试

挂掉1之后到2 上查看集群状态如下，可以发现2自动变成了主


rs0 [direct: primary] test> rs.status()
{
  set: 'rs0',
  date: ISODate("2022-12-17T12:18:35.005Z"),
  myState: 1,
  term: Long("2"),
  syncSourceHost: '',
  syncSourceId: -1,
  heartbeatIntervalMillis: Long("2000"),
  majorityVoteCount: 2,
  writeMajorityCount: 2,
  votingMembersCount: 3,
  writableVotingMembersCount: 3,
  optimes: {
    lastCommittedOpTime: { ts: Timestamp({ t: 1671279508, i: 1 }), t: Long("2") },
    lastCommittedWallTime: ISODate("2022-12-17T12:18:28.862Z"),
    readConcernMajorityOpTime: { ts: Timestamp({ t: 1671279508, i: 1 }), t: Long("2") },
    appliedOpTime: { ts: Timestamp({ t: 1671279508, i: 1 }), t: Long("2") },
    durableOpTime: { ts: Timestamp({ t: 1671279508, i: 1 }), t: Long("2") },
    lastAppliedWallTime: ISODate("2022-12-17T12:18:28.862Z"),
    lastDurableWallTime: ISODate("2022-12-17T12:18:28.862Z")
  },
  lastStableRecoveryTimestamp: Timestamp({ t: 1671279498, i: 1 }),
  electionCandidateMetrics: {
    lastElectionReason: 'stepUpRequestSkipDryRun',
    lastElectionDate: ISODate("2022-12-17T12:17:28.838Z"),
    electionTerm: Long("2"),
    lastCommittedOpTimeAtElection: { ts: Timestamp({ t: 1671279442, i: 1 }), t: Long("1") },
    lastSeenOpTimeAtElection: { ts: Timestamp({ t: 1671279442, i: 1 }), t: Long("1") },
    numVotesNeeded: 2,
    priorityAtElection: 1,
    electionTimeoutMillis: Long("10000"),
    priorPrimaryMemberId: 0,
    numCatchUpOps: Long("0"),
    newTermStartDate: ISODate("2022-12-17T12:17:28.858Z"),
    wMajorityWriteAvailabilityDate: ISODate("2022-12-17T12:17:29.859Z")
  },
  electionParticipantMetrics: {
    votedForCandidate: true,
    electionTerm: Long("1"),
    lastVoteDate: ISODate("2022-12-17T12:06:22.621Z"),
    electionCandidateMemberId: 0,
    voteReason: '',
    lastAppliedOpTimeAtElection: { ts: Timestamp({ t: 1671278771, i: 1 }), t: Long("-1") },
    maxAppliedOpTimeInSet: { ts: Timestamp({ t: 1671278771, i: 1 }), t: Long("-1") },
    priorityAtElection: 1
  },
  members: [
    {
      _id: 0,
      name: 'test1.mongo.db:27017',
      health: 0,
      state: 8,
      stateStr: '(not reachable/healthy)',
      uptime: 0,
      optime: { ts: Timestamp({ t: 0, i: 0 }), t: Long("-1") },
      optimeDurable: { ts: Timestamp({ t: 0, i: 0 }), t: Long("-1") },
      optimeDate: ISODate("1970-01-01T00:00:00.000Z"),
      optimeDurableDate: ISODate("1970-01-01T00:00:00.000Z"),
      lastAppliedWallTime: ISODate("2022-12-17T12:17:38.860Z"),
      lastDurableWallTime: ISODate("2022-12-17T12:17:38.860Z"),
      lastHeartbeat: ISODate("2022-12-17T12:18:33.050Z"),
      lastHeartbeatRecv: ISODate("2022-12-17T12:17:41.884Z"),
      pingMs: Long("0"),
      lastHeartbeatMessage: 'Error connecting to test1.mongo.db:27017 (192.168.2.224:27017) :: caused by :: Connection refused',
      syncSourceHost: '',
      syncSourceId: -1,
      infoMessage: '',
      configVersion: 1,
      configTerm: 2
    },
    {
      _id: 1,
      name: 'test2.mongo.db:27017',
      health: 1,
      state: 1,
      stateStr: 'PRIMARY',
      uptime: 839,
      optime: { ts: Timestamp({ t: 1671279508, i: 1 }), t: Long("2") },
      optimeDate: ISODate("2022-12-17T12:18:28.000Z"),
      lastAppliedWallTime: ISODate("2022-12-17T12:18:28.862Z"),
      lastDurableWallTime: ISODate("2022-12-17T12:18:28.862Z"),
      syncSourceHost: '',
      syncSourceId: -1,
      infoMessage: '',
      electionTime: Timestamp({ t: 1671279448, i: 1 }),
      electionDate: ISODate("2022-12-17T12:17:28.000Z"),
      configVersion: 1,
      configTerm: 2,
      self: true,
      lastHeartbeatMessage: ''
    },
    {
      _id: 2,
      name: 'test3.mongo.db:27017',
      health: 1,
      state: 2,
      stateStr: 'SECONDARY',
      uptime: 742,
      optime: { ts: Timestamp({ t: 1671279508, i: 1 }), t: Long("2") },
      optimeDurable: { ts: Timestamp({ t: 1671279508, i: 1 }), t: Long("2") },
      optimeDate: ISODate("2022-12-17T12:18:28.000Z"),
      optimeDurableDate: ISODate("2022-12-17T12:18:28.000Z"),
      lastAppliedWallTime: ISODate("2022-12-17T12:18:28.862Z"),
      lastDurableWallTime: ISODate("2022-12-17T12:18:28.862Z"),
      lastHeartbeat: ISODate("2022-12-17T12:18:34.909Z"),
      lastHeartbeatRecv: ISODate("2022-12-17T12:18:33.989Z"),
      pingMs: Long("0"),
      lastHeartbeatMessage: '',
      syncSourceHost: 'test2.mongo.db:27017',
      syncSourceId: 1,
      infoMessage: '',
      configVersion: 1,
      configTerm: 2
    }
  ],
  ok: 1,
  '$clusterTime': {
    clusterTime: Timestamp({ t: 1671279508, i: 1 }),
    signature: {
      hash: Binary(Buffer.from("0000000000000000000000000000000000000000", "hex"), 0),
      keyId: Long("0")
    }
  },
  operationTime: Timestamp({ t: 1671279508, i: 1 })
}

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

rs0 [direct: primary] test> rs.status()

{

set: 'rs0',

date: ISODate("2022-12-17T12:18:35.005Z"),

myState: 1,

term: Long("2"),

syncSourceHost: '',

syncSourceId: -1,

heartbeatIntervalMillis: Long("2000"),

majorityVoteCount: 2,

writeMajorityCount: 2,

votingMembersCount: 3,

writableVotingMembersCount: 3,

optimes: {

lastCommittedOpTime: { ts: Timestamp({ t: 1671279508, i: 1 }), t: Long("2") },

lastCommittedWallTime: ISODate("2022-12-17T12:18:28.862Z"),

readConcernMajorityOpTime: { ts: Timestamp({ t: 1671279508, i: 1 }), t: Long("2") },

appliedOpTime: { ts: Timestamp({ t: 1671279508, i: 1 }), t: Long("2") },

durableOpTime: { ts: Timestamp({ t: 1671279508, i: 1 }), t: Long("2") },

lastAppliedWallTime: ISODate("2022-12-17T12:18:28.862Z"),

lastDurableWallTime: ISODate("2022-12-17T12:18:28.862Z")

lastStableRecoveryTimestamp: Timestamp({ t: 1671279498, i: 1 }),

electionCandidateMetrics: {

lastElectionReason: 'stepUpRequestSkipDryRun',

lastElectionDate: ISODate("2022-12-17T12:17:28.838Z"),

electionTerm: Long("2"),

lastCommittedOpTimeAtElection: { ts: Timestamp({ t: 1671279442, i: 1 }), t: Long("1") },

lastSeenOpTimeAtElection: { ts: Timestamp({ t: 1671279442, i: 1 }), t: Long("1") },

numVotesNeeded: 2,

priorityAtElection: 1,

electionTimeoutMillis: Long("10000"),

priorPrimaryMemberId: 0,

numCatchUpOps: Long("0"),

newTermStartDate: ISODate("2022-12-17T12:17:28.858Z"),

wMajorityWriteAvailabilityDate: ISODate("2022-12-17T12:17:29.859Z")

electionParticipantMetrics: {

votedForCandidate: true,

electionTerm: Long("1"),

lastVoteDate: ISODate("2022-12-17T12:06:22.621Z"),

electionCandidateMemberId: 0,

voteReason: '',

lastAppliedOpTimeAtElection: { ts: Timestamp({ t: 1671278771, i: 1 }), t: Long("-1") },

maxAppliedOpTimeInSet: { ts: Timestamp({ t: 1671278771, i: 1 }), t: Long("-1") },

priorityAtElection: 1

members: [

{

_id: 0,

health: 0,

state: 8,

stateStr: '(not reachable/healthy)',

uptime: 0,

optime: { ts: Timestamp({ t: 0, i: 0 }), t: Long("-1") },

optimeDurable: { ts: Timestamp({ t: 0, i: 0 }), t: Long("-1") },

optimeDate: ISODate("1970-01-01T00:00:00.000Z"),

optimeDurableDate: ISODate("1970-01-01T00:00:00.000Z"),

lastAppliedWallTime: ISODate("2022-12-17T12:17:38.860Z"),

lastDurableWallTime: ISODate("2022-12-17T12:17:38.860Z"),

lastHeartbeat: ISODate("2022-12-17T12:18:33.050Z"),

lastHeartbeatRecv: ISODate("2022-12-17T12:17:41.884Z"),

pingMs: Long("0"),

lastHeartbeatMessage: 'Error connecting to test1.mongo.db:27017 (192.168.2.224:27017) :: caused by :: Connection refused',

syncSourceHost: '',

syncSourceId: -1,

infoMessage: '',

configVersion: 1,

configTerm: 2

{

_id: 1,

health: 1,

state: 1,

stateStr: 'PRIMARY',

uptime: 839,

optime: { ts: Timestamp({ t: 1671279508, i: 1 }), t: Long("2") },

optimeDate: ISODate("2022-12-17T12:18:28.000Z"),

lastAppliedWallTime: ISODate("2022-12-17T12:18:28.862Z"),

lastDurableWallTime: ISODate("2022-12-17T12:18:28.862Z"),

syncSourceHost: '',

syncSourceId: -1,

infoMessage: '',

electionTime: Timestamp({ t: 1671279448, i: 1 }),

electionDate: ISODate("2022-12-17T12:17:28.000Z"),

configVersion: 1,

configTerm: 2,

self: true,

lastHeartbeatMessage: ''

{

_id: 2,

health: 1,

state: 2,

stateStr: 'SECONDARY',

uptime: 742,

optime: { ts: Timestamp({ t: 1671279508, i: 1 }), t: Long("2") },

optimeDurable: { ts: Timestamp({ t: 1671279508, i: 1 }), t: Long("2") },

optimeDate: ISODate("2022-12-17T12:18:28.000Z"),

optimeDurableDate: ISODate("2022-12-17T12:18:28.000Z"),

lastAppliedWallTime: ISODate("2022-12-17T12:18:28.862Z"),

lastDurableWallTime: ISODate("2022-12-17T12:18:28.862Z"),

lastHeartbeat: ISODate("2022-12-17T12:18:34.909Z"),

lastHeartbeatRecv: ISODate("2022-12-17T12:18:33.989Z"),

pingMs: Long("0"),

lastHeartbeatMessage: '',

syncSourceHost: 'test2.mongo.db:27017',

syncSourceId: 1,

infoMessage: '',

configVersion: 1,

configTerm: 2

}

ok: 1,

'$clusterTime': {

clusterTime: Timestamp({ t: 1671279508, i: 1 }),

signature: {

hash: Binary(Buffer.from("0000000000000000000000000000000000000000", "hex"), 0),

keyId: Long("0")

}

operationTime: Timestamp({ t: 1671279508, i: 1 })

}

重启1之后，再次查看，可以发现1重新加入了集群，但身份是从节点


rs0 [direct: primary] test> rs.status()
{
  set: 'rs0',
  date: ISODate("2022-12-17T12:19:42.878Z"),
  myState: 1,
  term: Long("2"),
  syncSourceHost: '',
  syncSourceId: -1,
  heartbeatIntervalMillis: Long("2000"),
  majorityVoteCount: 2,
  writeMajorityCount: 2,
  votingMembersCount: 3,
  writableVotingMembersCount: 3,
  optimes: {
    lastCommittedOpTime: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },
    lastCommittedWallTime: ISODate("2022-12-17T12:19:39.170Z"),
    readConcernMajorityOpTime: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },
    appliedOpTime: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },
    durableOpTime: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },
    lastAppliedWallTime: ISODate("2022-12-17T12:19:39.170Z"),
    lastDurableWallTime: ISODate("2022-12-17T12:19:39.170Z")
  },
  lastStableRecoveryTimestamp: Timestamp({ t: 1671279558, i: 1 }),
  electionCandidateMetrics: {
    lastElectionReason: 'stepUpRequestSkipDryRun',
    lastElectionDate: ISODate("2022-12-17T12:17:28.838Z"),
    electionTerm: Long("2"),
    lastCommittedOpTimeAtElection: { ts: Timestamp({ t: 1671279442, i: 1 }), t: Long("1") },
    lastSeenOpTimeAtElection: { ts: Timestamp({ t: 1671279442, i: 1 }), t: Long("1") },
    numVotesNeeded: 2,
    priorityAtElection: 1,
    electionTimeoutMillis: Long("10000"),
    priorPrimaryMemberId: 0,
    numCatchUpOps: Long("0"),
    newTermStartDate: ISODate("2022-12-17T12:17:28.858Z"),
    wMajorityWriteAvailabilityDate: ISODate("2022-12-17T12:17:29.859Z")
  },
  electionParticipantMetrics: {
    votedForCandidate: true,
    electionTerm: Long("1"),
    lastVoteDate: ISODate("2022-12-17T12:06:22.621Z"),
    electionCandidateMemberId: 0,
    voteReason: '',
    lastAppliedOpTimeAtElection: { ts: Timestamp({ t: 1671278771, i: 1 }), t: Long("-1") },
    maxAppliedOpTimeInSet: { ts: Timestamp({ t: 1671278771, i: 1 }), t: Long("-1") },
    priorityAtElection: 1
  },
  members: [
    {
      _id: 0,
      name: 'test1.mongo.db:27017',
      health: 1,
      state: 2,
      stateStr: 'SECONDARY',
      uptime: 5,
      optime: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },
      optimeDurable: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },
      optimeDate: ISODate("2022-12-17T12:19:39.000Z"),
      optimeDurableDate: ISODate("2022-12-17T12:19:39.000Z"),
      lastAppliedWallTime: ISODate("2022-12-17T12:19:39.170Z"),
      lastDurableWallTime: ISODate("2022-12-17T12:19:39.170Z"),
      lastHeartbeat: ISODate("2022-12-17T12:19:41.318Z"),
      lastHeartbeatRecv: ISODate("2022-12-17T12:19:41.768Z"),
      pingMs: Long("0"),
      lastHeartbeatMessage: '',
      syncSourceHost: 'test3.mongo.db:27017',
      syncSourceId: 2,
      infoMessage: '',
      configVersion: 1,
      configTerm: 2
    },
    {
      _id: 1,
      name: 'test2.mongo.db:27017',
      health: 1,
      state: 1,
      stateStr: 'PRIMARY',
      uptime: 907,
      optime: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },
      optimeDate: ISODate("2022-12-17T12:19:39.000Z"),
      lastAppliedWallTime: ISODate("2022-12-17T12:19:39.170Z"),
      lastDurableWallTime: ISODate("2022-12-17T12:19:39.170Z"),
      syncSourceHost: '',
      syncSourceId: -1,
      infoMessage: '',
      electionTime: Timestamp({ t: 1671279448, i: 1 }),
      electionDate: ISODate("2022-12-17T12:17:28.000Z"),
      configVersion: 1,
      configTerm: 2,
      self: true,
      lastHeartbeatMessage: ''
    },
    {
      _id: 2,
      name: 'test3.mongo.db:27017',
      health: 1,
      state: 2,
      stateStr: 'SECONDARY',
      uptime: 810,
      optime: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },
      optimeDurable: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },
      optimeDate: ISODate("2022-12-17T12:19:39.000Z"),
      optimeDurableDate: ISODate("2022-12-17T12:19:39.000Z"),
      lastAppliedWallTime: ISODate("2022-12-17T12:19:39.170Z"),
      lastDurableWallTime: ISODate("2022-12-17T12:19:39.170Z"),
      lastHeartbeat: ISODate("2022-12-17T12:19:40.962Z"),
      lastHeartbeatRecv: ISODate("2022-12-17T12:19:42.044Z"),
      pingMs: Long("0"),
      lastHeartbeatMessage: '',
      syncSourceHost: 'test2.mongo.db:27017',
      syncSourceId: 1,
      infoMessage: '',
      configVersion: 1,
      configTerm: 2
    }
  ],
  ok: 1,
  '$clusterTime': {
    clusterTime: Timestamp({ t: 1671279579, i: 1 }),
    signature: {
      hash: Binary(Buffer.from("0000000000000000000000000000000000000000", "hex"), 0),
      keyId: Long("0")
    }
  },
  operationTime: Timestamp({ t: 1671279579, i: 1 })
}

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

rs0 [direct: primary] test> rs.status()

{

set: 'rs0',

date: ISODate("2022-12-17T12:19:42.878Z"),

myState: 1,

term: Long("2"),

syncSourceHost: '',

syncSourceId: -1,

heartbeatIntervalMillis: Long("2000"),

majorityVoteCount: 2,

writeMajorityCount: 2,

votingMembersCount: 3,

writableVotingMembersCount: 3,

optimes: {

lastCommittedOpTime: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },

lastCommittedWallTime: ISODate("2022-12-17T12:19:39.170Z"),

readConcernMajorityOpTime: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },

appliedOpTime: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },

durableOpTime: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },

lastAppliedWallTime: ISODate("2022-12-17T12:19:39.170Z"),

lastDurableWallTime: ISODate("2022-12-17T12:19:39.170Z")

lastStableRecoveryTimestamp: Timestamp({ t: 1671279558, i: 1 }),

electionCandidateMetrics: {

lastElectionReason: 'stepUpRequestSkipDryRun',

lastElectionDate: ISODate("2022-12-17T12:17:28.838Z"),

electionTerm: Long("2"),

lastCommittedOpTimeAtElection: { ts: Timestamp({ t: 1671279442, i: 1 }), t: Long("1") },

lastSeenOpTimeAtElection: { ts: Timestamp({ t: 1671279442, i: 1 }), t: Long("1") },

numVotesNeeded: 2,

priorityAtElection: 1,

electionTimeoutMillis: Long("10000"),

priorPrimaryMemberId: 0,

numCatchUpOps: Long("0"),

newTermStartDate: ISODate("2022-12-17T12:17:28.858Z"),

wMajorityWriteAvailabilityDate: ISODate("2022-12-17T12:17:29.859Z")

electionParticipantMetrics: {

votedForCandidate: true,

electionTerm: Long("1"),

lastVoteDate: ISODate("2022-12-17T12:06:22.621Z"),

electionCandidateMemberId: 0,

voteReason: '',

lastAppliedOpTimeAtElection: { ts: Timestamp({ t: 1671278771, i: 1 }), t: Long("-1") },

maxAppliedOpTimeInSet: { ts: Timestamp({ t: 1671278771, i: 1 }), t: Long("-1") },

priorityAtElection: 1

members: [

{

_id: 0,

health: 1,

state: 2,

stateStr: 'SECONDARY',

uptime: 5,

optime: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },

optimeDurable: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },

optimeDate: ISODate("2022-12-17T12:19:39.000Z"),

optimeDurableDate: ISODate("2022-12-17T12:19:39.000Z"),

lastAppliedWallTime: ISODate("2022-12-17T12:19:39.170Z"),

lastDurableWallTime: ISODate("2022-12-17T12:19:39.170Z"),

lastHeartbeat: ISODate("2022-12-17T12:19:41.318Z"),

lastHeartbeatRecv: ISODate("2022-12-17T12:19:41.768Z"),

pingMs: Long("0"),

lastHeartbeatMessage: '',

syncSourceHost: 'test3.mongo.db:27017',

syncSourceId: 2,

infoMessage: '',

configVersion: 1,

configTerm: 2

{

_id: 1,

health: 1,

state: 1,

stateStr: 'PRIMARY',

uptime: 907,

optime: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },

optimeDate: ISODate("2022-12-17T12:19:39.000Z"),

lastAppliedWallTime: ISODate("2022-12-17T12:19:39.170Z"),

lastDurableWallTime: ISODate("2022-12-17T12:19:39.170Z"),

syncSourceHost: '',

syncSourceId: -1,

infoMessage: '',

electionTime: Timestamp({ t: 1671279448, i: 1 }),

electionDate: ISODate("2022-12-17T12:17:28.000Z"),

configVersion: 1,

configTerm: 2,

self: true,

lastHeartbeatMessage: ''

{

_id: 2,

health: 1,

state: 2,

stateStr: 'SECONDARY',

uptime: 810,

optime: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },

optimeDurable: { ts: Timestamp({ t: 1671279579, i: 1 }), t: Long("2") },

optimeDate: ISODate("2022-12-17T12:19:39.000Z"),

optimeDurableDate: ISODate("2022-12-17T12:19:39.000Z"),

lastAppliedWallTime: ISODate("2022-12-17T12:19:39.170Z"),

lastDurableWallTime: ISODate("2022-12-17T12:19:39.170Z"),

lastHeartbeat: ISODate("2022-12-17T12:19:40.962Z"),

lastHeartbeatRecv: ISODate("2022-12-17T12:19:42.044Z"),

pingMs: Long("0"),

lastHeartbeatMessage: '',

syncSourceHost: 'test2.mongo.db:27017',

syncSourceId: 1,

infoMessage: '',

configVersion: 1,

configTerm: 2

}

ok: 1,

'$clusterTime': {

clusterTime: Timestamp({ t: 1671279579, i: 1 }),

signature: {

hash: Binary(Buffer.from("0000000000000000000000000000000000000000", "hex"), 0),

keyId: Long("0")

}

operationTime: Timestamp({ t: 1671279579, i: 1 })

}

从2写入点新数据，到1查询测试，可以发现是正常的


rs0 [direct: secondary] test> use sample_mflix
switched to db sample_mflix
rs0 [direct: secondary] sample_mflix> db.getMongo().setReadPref('secondary')

rs0 [direct: secondary] sample_mflix> db.movies.find( { title: "The Favourite1" } )
[
  {
    _id: ObjectId("639db429d29c478bd6ec0507"),
    title: 'The Favourite1',
    genres: [ 'Drama', 'History' ],
    runtime: 121,
    rated: 'R',
    year: 2018,
    directors: [ 'Yorgos Lanthimos' ],
    cast: [ 'Olivia Colman', 'Emma Stone', 'Rachel Weisz' ],
    type: 'movie'
  }
]
rs0 [direct: secondary] sample_mflix>

rs0 [direct: secondary] test> use sample_mflix

switched to db sample_mflix

rs0 [direct: secondary] sample_mflix> db.getMongo().setReadPref('secondary')

rs0 [direct: secondary] sample_mflix> db.movies.find( { title: "The Favourite1" } )

[

{

_id: ObjectId("639db429d29c478bd6ec0507"),

title: 'The Favourite1',

genres: [ 'Drama', 'History' ],

runtime: 121,

rated: 'R',

year: 2018,

directors: [ 'Yorgos Lanthimos' ],

cast: [ 'Olivia Colman', 'Emma Stone', 'Rachel Weisz' ],

type: 'movie'

}

]

rs0 [direct: secondary] sample_mflix>

挂掉现在的从节点3，写入新数据后再重启3


rs0 [direct: primary] sample_mflix> rs.status()
{
  set: 'rs0',
  date: ISODate("2022-12-17T12:22:41.079Z"),
  myState: 1,
  term: Long("2"),
  syncSourceHost: '',
  syncSourceId: -1,
  heartbeatIntervalMillis: Long("2000"),
  majorityVoteCount: 2,
  writeMajorityCount: 2,
  votingMembersCount: 3,
  writableVotingMembersCount: 3,
  optimes: {
    lastCommittedOpTime: { ts: Timestamp({ t: 1671279758, i: 1 }), t: Long("2") },
    lastCommittedWallTime: ISODate("2022-12-17T12:22:38.878Z"),
    readConcernMajorityOpTime: { ts: Timestamp({ t: 1671279758, i: 1 }), t: Long("2") },
    appliedOpTime: { ts: Timestamp({ t: 1671279758, i: 1 }), t: Long("2") },
    durableOpTime: { ts: Timestamp({ t: 1671279758, i: 1 }), t: Long("2") },
    lastAppliedWallTime: ISODate("2022-12-17T12:22:38.878Z"),
    lastDurableWallTime: ISODate("2022-12-17T12:22:38.878Z")
  },
  lastStableRecoveryTimestamp: Timestamp({ t: 1671279738, i: 1 }),
  electionCandidateMetrics: {
    lastElectionReason: 'stepUpRequestSkipDryRun',
    lastElectionDate: ISODate("2022-12-17T12:17:28.838Z"),
    electionTerm: Long("2"),
    lastCommittedOpTimeAtElection: { ts: Timestamp({ t: 1671279442, i: 1 }), t: Long("1") },
    lastSeenOpTimeAtElection: { ts: Timestamp({ t: 1671279442, i: 1 }), t: Long("1") },
    numVotesNeeded: 2,
    priorityAtElection: 1,
    electionTimeoutMillis: Long("10000"),
    priorPrimaryMemberId: 0,
    numCatchUpOps: Long("0"),
    newTermStartDate: ISODate("2022-12-17T12:17:28.858Z"),
    wMajorityWriteAvailabilityDate: ISODate("2022-12-17T12:17:29.859Z")
  },
  electionParticipantMetrics: {
    votedForCandidate: true,
    electionTerm: Long("1"),
    lastVoteDate: ISODate("2022-12-17T12:06:22.621Z"),
    electionCandidateMemberId: 0,
    voteReason: '',
    lastAppliedOpTimeAtElection: { ts: Timestamp({ t: 1671278771, i: 1 }), t: Long("-1") },
    maxAppliedOpTimeInSet: { ts: Timestamp({ t: 1671278771, i: 1 }), t: Long("-1") },
    priorityAtElection: 1
  },
  members: [
    {
      _id: 0,
      name: 'test1.mongo.db:27017',
      health: 1,
      state: 2,
      stateStr: 'SECONDARY',
      uptime: 183,
      optime: { ts: Timestamp({ t: 1671279748, i: 1 }), t: Long("2") },
      optimeDurable: { ts: Timestamp({ t: 1671279748, i: 1 }), t: Long("2") },
      optimeDate: ISODate("2022-12-17T12:22:28.000Z"),
      optimeDurableDate: ISODate("2022-12-17T12:22:28.000Z"),
      lastAppliedWallTime: ISODate("2022-12-17T12:22:38.878Z"),
      lastDurableWallTime: ISODate("2022-12-17T12:22:38.878Z"),
      lastHeartbeat: ISODate("2022-12-17T12:22:39.460Z"),
      lastHeartbeatRecv: ISODate("2022-12-17T12:22:39.967Z"),
      pingMs: Long("0"),
      lastHeartbeatMessage: '',
      syncSourceHost: '',
      syncSourceId: -1,
      infoMessage: '',
      configVersion: 1,
      configTerm: 2
    },
    {
      _id: 1,
      name: 'test2.mongo.db:27017',
      health: 1,
      state: 1,
      stateStr: 'PRIMARY',
      uptime: 1086,
      optime: { ts: Timestamp({ t: 1671279758, i: 1 }), t: Long("2") },
      optimeDate: ISODate("2022-12-17T12:22:38.000Z"),
      lastAppliedWallTime: ISODate("2022-12-17T12:22:38.878Z"),
      lastDurableWallTime: ISODate("2022-12-17T12:22:38.878Z"),
      syncSourceHost: '',
      syncSourceId: -1,
      infoMessage: '',
      electionTime: Timestamp({ t: 1671279448, i: 1 }),
      electionDate: ISODate("2022-12-17T12:17:28.000Z"),
      configVersion: 1,
      configTerm: 2,
      self: true,
      lastHeartbeatMessage: ''
    },
    {
      _id: 2,
      name: 'test3.mongo.db:27017',
      health: 0,
      state: 8,
      stateStr: '(not reachable/healthy)',
      uptime: 0,
      optime: { ts: Timestamp({ t: 0, i: 0 }), t: Long("-1") },
      optimeDurable: { ts: Timestamp({ t: 0, i: 0 }), t: Long("-1") },
      optimeDate: ISODate("1970-01-01T00:00:00.000Z"),
      optimeDurableDate: ISODate("1970-01-01T00:00:00.000Z"),
      lastAppliedWallTime: ISODate("2022-12-17T12:22:28.878Z"),
      lastDurableWallTime: ISODate("2022-12-17T12:22:28.878Z"),
      lastHeartbeat: ISODate("2022-12-17T12:22:39.106Z"),
      lastHeartbeatRecv: ISODate("2022-12-17T12:22:34.175Z"),
      pingMs: Long("0"),
      lastHeartbeatMessage: 'Error connecting to test3.mongo.db:27017 (192.168.2.178:27017) :: caused by :: Connection refused',
      syncSourceHost: '',
      syncSourceId: -1,
      infoMessage: '',
      configVersion: 1,
      configTerm: 2
    }
  ],
  ok: 1,
  '$clusterTime': {
    clusterTime: Timestamp({ t: 1671279758, i: 1 }),
    signature: {
      hash: Binary(Buffer.from("0000000000000000000000000000000000000000", "hex"), 0),
      keyId: Long("0")
    }
  },
  operationTime: Timestamp({ t: 1671279758, i: 1 })
}

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

rs0 [direct: primary] sample_mflix> rs.status()

{

set: 'rs0',

date: ISODate("2022-12-17T12:22:41.079Z"),

myState: 1,

term: Long("2"),

syncSourceHost: '',

syncSourceId: -1,

heartbeatIntervalMillis: Long("2000"),

majorityVoteCount: 2,

writeMajorityCount: 2,

votingMembersCount: 3,

writableVotingMembersCount: 3,

optimes: {

lastCommittedOpTime: { ts: Timestamp({ t: 1671279758, i: 1 }), t: Long("2") },

lastCommittedWallTime: ISODate("2022-12-17T12:22:38.878Z"),

readConcernMajorityOpTime: { ts: Timestamp({ t: 1671279758, i: 1 }), t: Long("2") },

appliedOpTime: { ts: Timestamp({ t: 1671279758, i: 1 }), t: Long("2") },

durableOpTime: { ts: Timestamp({ t: 1671279758, i: 1 }), t: Long("2") },

lastAppliedWallTime: ISODate("2022-12-17T12:22:38.878Z"),

lastDurableWallTime: ISODate("2022-12-17T12:22:38.878Z")

lastStableRecoveryTimestamp: Timestamp({ t: 1671279738, i: 1 }),

electionCandidateMetrics: {

lastElectionReason: 'stepUpRequestSkipDryRun',

lastElectionDate: ISODate("2022-12-17T12:17:28.838Z"),

electionTerm: Long("2"),

lastCommittedOpTimeAtElection: { ts: Timestamp({ t: 1671279442, i: 1 }), t: Long("1") },

lastSeenOpTimeAtElection: { ts: Timestamp({ t: 1671279442, i: 1 }), t: Long("1") },

numVotesNeeded: 2,

priorityAtElection: 1,

electionTimeoutMillis: Long("10000"),

priorPrimaryMemberId: 0,

numCatchUpOps: Long("0"),

newTermStartDate: ISODate("2022-12-17T12:17:28.858Z"),

wMajorityWriteAvailabilityDate: ISODate("2022-12-17T12:17:29.859Z")

electionParticipantMetrics: {

votedForCandidate: true,

electionTerm: Long("1"),

lastVoteDate: ISODate("2022-12-17T12:06:22.621Z"),

electionCandidateMemberId: 0,

voteReason: '',

lastAppliedOpTimeAtElection: { ts: Timestamp({ t: 1671278771, i: 1 }), t: Long("-1") },

maxAppliedOpTimeInSet: { ts: Timestamp({ t: 1671278771, i: 1 }), t: Long("-1") },

priorityAtElection: 1

members: [

{

_id: 0,

health: 1,

state: 2,

stateStr: 'SECONDARY',

uptime: 183,

optime: { ts: Timestamp({ t: 1671279748, i: 1 }), t: Long("2") },

optimeDurable: { ts: Timestamp({ t: 1671279748, i: 1 }), t: Long("2") },

optimeDate: ISODate("2022-12-17T12:22:28.000Z"),

optimeDurableDate: ISODate("2022-12-17T12:22:28.000Z"),

lastAppliedWallTime: ISODate("2022-12-17T12:22:38.878Z"),

lastDurableWallTime: ISODate("2022-12-17T12:22:38.878Z"),

lastHeartbeat: ISODate("2022-12-17T12:22:39.460Z"),

lastHeartbeatRecv: ISODate("2022-12-17T12:22:39.967Z"),

pingMs: Long("0"),

lastHeartbeatMessage: '',

syncSourceHost: '',

syncSourceId: -1,

infoMessage: '',

configVersion: 1,

configTerm: 2

{

_id: 1,

health: 1,

state: 1,

stateStr: 'PRIMARY',

uptime: 1086,

optime: { ts: Timestamp({ t: 1671279758, i: 1 }), t: Long("2") },

optimeDate: ISODate("2022-12-17T12:22:38.000Z"),

lastAppliedWallTime: ISODate("2022-12-17T12:22:38.878Z"),

lastDurableWallTime: ISODate("2022-12-17T12:22:38.878Z"),

syncSourceHost: '',

syncSourceId: -1,

infoMessage: '',

electionTime: Timestamp({ t: 1671279448, i: 1 }),

electionDate: ISODate("2022-12-17T12:17:28.000Z"),

configVersion: 1,

configTerm: 2,

self: true,

lastHeartbeatMessage: ''

{

_id: 2,

health: 0,

state: 8,

stateStr: '(not reachable/healthy)',

uptime: 0,

optime: { ts: Timestamp({ t: 0, i: 0 }), t: Long("-1") },

optimeDurable: { ts: Timestamp({ t: 0, i: 0 }), t: Long("-1") },

optimeDate: ISODate("1970-01-01T00:00:00.000Z"),

optimeDurableDate: ISODate("1970-01-01T00:00:00.000Z"),

lastAppliedWallTime: ISODate("2022-12-17T12:22:28.878Z"),

lastDurableWallTime: ISODate("2022-12-17T12:22:28.878Z"),

lastHeartbeat: ISODate("2022-12-17T12:22:39.106Z"),

lastHeartbeatRecv: ISODate("2022-12-17T12:22:34.175Z"),

pingMs: Long("0"),

lastHeartbeatMessage: 'Error connecting to test3.mongo.db:27017 (192.168.2.178:27017) :: caused by :: Connection refused',

syncSourceHost: '',

syncSourceId: -1,

infoMessage: '',

configVersion: 1,

configTerm: 2

}

ok: 1,

'$clusterTime': {

clusterTime: Timestamp({ t: 1671279758, i: 1 }),

signature: {

hash: Binary(Buffer.from("0000000000000000000000000000000000000000", "hex"), 0),

keyId: Long("0")

}

operationTime: Timestamp({ t: 1671279758, i: 1 })

}

可以发现新写入的数据依然可以正常查询


rs0 [direct: secondary] sample_mflix> db.getMongo().setReadPref('secondary')

rs0 [direct: secondary] sample_mflix> db.movies.find( { title: "The Favourite2" } )
[
  {
    _id: ObjectId("639db4b7d29c478bd6ec0508"),
    title: 'The Favourite2',
    genres: [ 'Drama', 'History' ],
    runtime: 121,
    rated: 'R',
    year: 2018,
    directors: [ 'Yorgos Lanthimos' ],
    cast: [ 'Olivia Colman', 'Emma Stone', 'Rachel Weisz' ],
    type: 'movie'
  }
]

rs0 [direct: secondary] sample_mflix> db.getMongo().setReadPref('secondary')

rs0 [direct: secondary] sample_mflix> db.movies.find( { title: "The Favourite2" } )

[

{

_id: ObjectId("639db4b7d29c478bd6ec0508"),

title: 'The Favourite2',

genres: [ 'Drama', 'History' ],

runtime: 121,

rated: 'R',

year: 2018,

directors: [ 'Yorgos Lanthimos' ],

cast: [ 'Olivia Colman', 'Emma Stone', 'Rachel Weisz' ],

type: 'movie'

}

]

附录


mongo

https://mirrors.tuna.tsinghua.edu.cn

#分配DNS
192.168.2.224 test1.mongo.db
192.168.2.147 test2.mongo.db
192.168.2.178 test3.mongo.db

#远程ssh+免密+禁用密码登录
ssh mongo1@test1.mongo.db
ssh mongo2@test2.mongo.db
ssh mongo3@test3.mongo.db

#安装mongo
wget -qO - https://www.mongodb.org/static/pgp/server-6.0.asc | sudo apt-key add -
sudo touch /etc/apt/sources.list.d/mongodb-org-6.0.list
echo "deb [ arch=amd64,arm64 ] https://repo.mongodb.org/apt/ubuntu focal/mongodb-org/6.0 multiverse" | sudo tee /etc/apt/sources.list.d/mongodb-org-6.0.list
sudo apt-get update
sudo apt-get install -y mongodb-org

#单机测试
mongosh
端口 27017
db
use test

#集群配置
修改每个机器的bindIp
sudo vim /etc/mongod.conf
sudo service mongod restart

#尝试远程连接
mongosh test1.mongo.db
mongosh test2.mongo.db
mongosh test3.mongo.db

#配置集群名
  replSetName: "rs0"

sudo vim /etc/mongod.conf
sudo service mongod restart

#初始化集群
rs.initiate( {
   _id : "rs0",
   members: [
      { _id: 0, host: "test1.mongo.db:27017" },
      { _id: 1, host: "test2.mongo.db:27017" },
      { _id: 2, host: "test3.mongo.db:27017" }
   ]
})

rs.conf()

rs.status()

#集群测试
use sample_mflix

db.movies.insertOne(
  {
    title: "The Favourite",
    genres: [ "Drama", "History" ],
    runtime: 121,
    rated: "R",
    year: 2018,
    directors: [ "Yorgos Lanthimos" ],
    cast: [ "Olivia Colman", "Emma Stone", "Rachel Weisz" ],
    type: "movie"
  }
)

db.getMongo().setReadPref('secondary')
db.movies.find( { title: "The Favourite" } )

mongo

https://mirrors.tuna.tsinghua.edu.cn

#分配DNS

192.168.2.224 test1.mongo.db

192.168.2.147 test2.mongo.db

192.168.2.178 test3.mongo.db

#远程ssh+免密+禁用密码登录

ssh mongo1@test1.mongo.db

ssh mongo2@test2.mongo.db

ssh mongo3@test3.mongo.db

#安装mongo

wget -qO - https://www.mongodb.org/static/pgp/server-6.0.asc | sudo apt-key add -

sudo touch /etc/apt/sources.list.d/mongodb-org-6.0.list

echo "deb [ arch=amd64,arm64 ] https://repo.mongodb.org/apt/ubuntu focal/mongodb-org/6.0 multiverse" | sudo tee /etc/apt/sources.list.d/mongodb-org-6.0.list

sudo apt-get update

sudo apt-get install -y mongodb-org

#单机测试

mongosh

端口 27017

use test

#集群配置

修改每个机器的bindIp

sudo vim /etc/mongod.conf

sudo service mongod restart

#尝试远程连接

mongosh test1.mongo.db

mongosh test2.mongo.db

mongosh test3.mongo.db

#配置集群名

replSetName: "rs0"

sudo vim /etc/mongod.conf

sudo service mongod restart

#初始化集群

rs.initiate( {

_id : "rs0",

members: [

{ _id: 0, host: "test1.mongo.db:27017" },

{ _id: 1, host: "test2.mongo.db:27017" },

{ _id: 2, host: "test3.mongo.db:27017" }

]

})

rs.conf()

rs.status()

#集群测试

use sample_mflix

db.movies.insertOne(

{

title: "The Favourite",

genres: [ "Drama", "History" ],

runtime: 121,

rated: "R",

year: 2018,

directors: [ "Yorgos Lanthimos" ],

cast: [ "Olivia Colman", "Emma Stone", "Rachel Weisz" ],

type: "movie"

}

)

db.getMongo().setReadPref('secondary')

db.movies.find( { title: "The Favourite" } )

参考

https://www.mongodb.com/docs/manual/

https://www.mongodb.com/docs/manual/tutorial/install-mongodb-on-ubuntu/#install-mongodb-community-edition

https://www.mongodb.com/docs/manual/replication/

https://www.mongodb.com/docs/manual/tutorial/deploy-replica-set/

https://www.mongodb.com/docs/manual/tutorial/deploy-replica-set-with-keyfile-access-control/#std-label-deploy-repl-set-with-auth

20221127redis-sentinel集群搭建

视频版

https://www.bilibili.com/video/BV1u84y1y7Mu/

1.安装redis

环境信息，按官方文档准备三个节点


redis1
192.168.2.104
ssh redis1@192.168.2.104

redis2
192.168.2.166
ssh redis2@192.168.2.166

redis3
192.168.2.139
ssh redis3@192.168.2.139

redis1

192.168.2.104

ssh redis1@192.168.2.104

redis2

192.168.2.166

ssh redis2@192.168.2.166

redis3

192.168.2.139

ssh redis3@192.168.2.139

执行安装过程


curl -fsSL https://packages.redis.io/gpg | sudo gpg --dearmor -o /usr/share/keyrings/redis-archive-keyring.gpg

echo "deb [signed-by=/usr/share/keyrings/redis-archive-keyring.gpg] https://packages.redis.io/deb $(lsb_release -cs) main" | sudo tee /etc/apt/sources.list.d/redis.list

sudo apt-get update
sudo apt-get install redis redis-sentinel

curl -fsSL https://packages.redis.io/gpg | sudo gpg --dearmor -o /usr/share/keyrings/redis-archive-keyring.gpg

echo "deb [signed-by=/usr/share/keyrings/redis-archive-keyring.gpg] https://packages.redis.io/deb $(lsb_release -cs) main" | sudo tee /etc/apt/sources.list.d/redis.list

sudo apt-get update

sudo apt-get install redis redis-sentinel

2.配置集群复制配置

复制的配置，假设第一个是主节点。这里测试没做安全防护，生产记得加密码和网段限制


sudo vim /etc/redis/redis.conf
#config all nodes
bind * -::1
protected-mode no

#only in redis2 and redis3
replicaof 192.168.2.104 6379

sudo vim /etc/redis/redis.conf

#config all nodes

bind * -::1

protected-mode no

#only in redis2 and redis3

replicaof 192.168.2.104 6379

记得重启，之后测试集群复制情况，正常后继续配置sentinel


redis1@redis1:~$ redis-cli -p 6379
127.0.0.1:6379> get test
"2"
127.0.0.1:6379> set test 1
OK
127.0.0.1:6379> get test
"1"
127.0.0.1:6379> exit
redis1@redis1:~$ redis-cli -h 192.168.2.166 -p 6379
192.168.2.166:6379> get test
"1"
192.168.2.166:6379>
redis1@redis1:~$ ^C
redis1@redis1:~$ redis-cli -h 192.168.2.139 -p 6379
192.168.2.139:6379> get test
"1"
192.168.2.139:6379>

redis1@redis1:~$ redis-cli -p 6379

127.0.0.1:6379> get test

"2"

127.0.0.1:6379> set test 1

127.0.0.1:6379> get test

"1"

127.0.0.1:6379> exit

redis1@redis1:~$ redis-cli -h 192.168.2.166 -p 6379

192.168.2.166:6379> get test

"1"

192.168.2.166:6379>

redis1@redis1:~$ ^C

redis1@redis1:~$ redis-cli -h 192.168.2.139 -p 6379

192.168.2.139:6379> get test

"1"

192.168.2.139:6379>

3.配置sentinel

新建配置文件sentinel.conf 这里测试的是自己新建的，记得关掉系统的service防止干扰。实际应该修改/etc/redis下的配置


port 5000
sentinel monitor mymaster 127.0.0.1 6379 2
sentinel down-after-milliseconds mymaster 5000
sentinel failover-timeout mymaster 60000
sentinel parallel-syncs mymaster 1

#with ip or port mapping(docker or nat)
sentinel announce-ip <ip>
sentinel announce-port <port>

port 5000

sentinel monitor mymaster 127.0.0.1 6379 2

sentinel down-after-milliseconds mymaster 5000

sentinel failover-timeout mymaster 60000

sentinel parallel-syncs mymaster 1

#with ip or port mapping(docker or nat)

sentinel announce-ip <ip>

sentinel announce-port <port>

启动成功效果


redis1@redis1:~$ redis-sentinel sentinel.conf
3385:X 27 Nov 2022 12:11:35.380 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
3385:X 27 Nov 2022 12:11:35.380 # Redis version=7.0.5, bits=64, commit=00000000, modified=0, pid=3385, just started
3385:X 27 Nov 2022 12:11:35.380 # Configuration loaded
3385:X 27 Nov 2022 12:11:35.381 * Increased maximum number of open files to 10032 (it was originally set to 1024).
3385:X 27 Nov 2022 12:11:35.381 * monotonic clock: POSIX clock_gettime
                _._
           _.-``__ ''-._
      _.-``    `.  `_.  ''-._           Redis 7.0.5 (00000000/0) 64 bit
  .-`` .-```.  ```\/    _.,_ ''-._
 (    '      ,       .-`  | `,    )     Running in sentinel mode
 |`-._`-...-` __...-.``-._|'` _.-'|     Port: 5000
 |    `-._   `._    /     _.-'    |     PID: 3385
  `-._    `-._  `-./  _.-'    _.-'
 |`-._`-._    `-.__.-'    _.-'_.-'|
 |    `-._`-._        _.-'_.-'    |           https://redis.io
  `-._    `-._`-.__.-'_.-'    _.-'
 |`-._`-._    `-.__.-'    _.-'_.-'|
 |    `-._`-._        _.-'_.-'    |
  `-._    `-._`-.__.-'_.-'    _.-'
      `-._    `-.__.-'    _.-'
          `-._        _.-'
              `-.__.-'

3385:X 27 Nov 2022 12:11:35.387 * Sentinel new configuration saved on disk
3385:X 27 Nov 2022 12:11:35.387 # Sentinel ID is 9a7a4e3269530706fd1002c3018a3f0c525c25d6
3385:X 27 Nov 2022 12:11:35.387 # +monitor master mymaster 192.168.2.104 6379 quorum 2
3385:X 27 Nov 2022 12:11:52.666 * +sentinel sentinel ea6cbec52f9c04c6c325414a05562a69b503129c 192.168.2.166 5000 @ mymaster 192.168.2.104 6379
3385:X 27 Nov 2022 12:11:52.670 * Sentinel new configuration saved on disk
3385:X 27 Nov 2022 12:11:59.182 * +sentinel sentinel 095fc33d13e733d7f974faf0c2b2e6aba015fc3f 192.168.2.139 5000 @ mymaster 192.168.2.104 6379
3385:X 27 Nov 2022 12:11:59.186 * Sentinel new configuration saved on disk

redis1@redis1:~$ redis-sentinel sentinel.conf

3385:X 27 Nov 2022 12:11:35.380 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo

3385:X 27 Nov 2022 12:11:35.380 # Redis version=7.0.5, bits=64, commit=00000000, modified=0, pid=3385, just started

3385:X 27 Nov 2022 12:11:35.380 # Configuration loaded

3385:X 27 Nov 2022 12:11:35.381 * Increased maximum number of open files to 10032 (it was originally set to 1024).

3385:X 27 Nov 2022 12:11:35.381 * monotonic clock: POSIX clock_gettime

_._

_.-``__ ''-._

_.-`` `. `_. ''-._ Redis 7.0.5 (00000000/0) 64 bit

.-`` .-```. ```\/ _.,_ ''-._

( ' , .-` | `, ) Running in sentinel mode

|`-._`-...-` __...-.``-._|'` _.-'| Port: 5000

| `-._ `._ / _.-' | PID: 3385

`-._ `-._ `-./ _.-' _.-'

|`-._`-._ `-.__.-' _.-'_.-'|

| `-._`-._ _.-'_.-' | https://redis.io

`-._ `-._`-.__.-'_.-' _.-'

|`-._`-._ `-.__.-' _.-'_.-'|

| `-._`-._ _.-'_.-' |

`-._ `-._`-.__.-'_.-' _.-'

`-._ `-.__.-' _.-'

`-._ _.-'

`-.__.-'

3385:X 27 Nov 2022 12:11:35.387 * Sentinel new configuration saved on disk

3385:X 27 Nov 2022 12:11:35.387 # Sentinel ID is 9a7a4e3269530706fd1002c3018a3f0c525c25d6

3385:X 27 Nov 2022 12:11:35.387 # +monitor master mymaster 192.168.2.104 6379 quorum 2

3385:X 27 Nov 2022 12:11:52.666 * +sentinel sentinel ea6cbec52f9c04c6c325414a05562a69b503129c 192.168.2.166 5000 @ mymaster 192.168.2.104 6379

3385:X 27 Nov 2022 12:11:52.670 * Sentinel new configuration saved on disk

3385:X 27 Nov 2022 12:11:59.182 * +sentinel sentinel 095fc33d13e733d7f974faf0c2b2e6aba015fc3f 192.168.2.139 5000 @ mymaster 192.168.2.104 6379

3385:X 27 Nov 2022 12:11:59.186 * Sentinel new configuration saved on disk

观察端口监听5000


redis1@redis1:~$ netstat -anp|grep 5000
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
tcp        0      0 0.0.0.0:5000            0.0.0.0:*               LISTEN      3385/redis-sentinel
tcp        0      0 192.168.2.104:55560     192.168.2.139:5000      ESTABLISHED 3385/redis-sentinel
tcp        0      0 192.168.2.104:44506     192.168.2.166:5000      ESTABLISHED 3385/redis-sentinel
tcp        0      0 192.168.2.104:5000      192.168.2.166:36802     ESTABLISHED 3385/redis-sentinel
tcp        0      0 192.168.2.104:5000      192.168.2.139:33910     ESTABLISHED 3385/redis-sentinel
tcp6       0      0 :::5000                 :::*                    LISTEN      3385/redis-sentinel

redis1@redis1:~$ netstat -anp|grep 5000

(Not all processes could be identified, non-owned process info

will not be shown, you would have to be root to see it all.)

tcp 0 0 0.0.0.0:5000 0.0.0.0:* LISTEN 3385/redis-sentinel

tcp 0 0 192.168.2.104:55560 192.168.2.139:5000 ESTABLISHED 3385/redis-sentinel

tcp 0 0 192.168.2.104:44506 192.168.2.166:5000 ESTABLISHED 3385/redis-sentinel

tcp 0 0 192.168.2.104:5000 192.168.2.166:36802 ESTABLISHED 3385/redis-sentinel

tcp 0 0 192.168.2.104:5000 192.168.2.139:33910 ESTABLISHED 3385/redis-sentinel

tcp6 0 0 :::5000 :::* LISTEN 3385/redis-sentinel

查看集群状态


sentinel master mymaster
SENTINEL get-master-addr-by-name mymaster
SENTINEL replicas mymaster
SENTINEL sentinels mymaster

sentinel master mymaster

SENTINEL get-master-addr-by-name mymaster

SENTINEL replicas mymaster

SENTINEL sentinels mymaster

redis1


redis1@redis1:~$ redis-cli -p 5000
127.0.0.1:5000> sentinel master mymaster
 1) "name"
 2) "mymaster"
 3) "ip"
 4) "192.168.2.104"
 5) "port"
 6) "6379"
 7) "runid"
 8) "4097e9a96cdb74dd4239aede54843e33104e6913"
 9) "flags"
10) "master"
11) "link-pending-commands"
12) "0"
13) "link-refcount"
14) "1"
15) "last-ping-sent"
16) "0"
17) "last-ok-ping-reply"
18) "244"
19) "last-ping-reply"
20) "244"
21) "down-after-milliseconds"
22) "5000"
23) "info-refresh"
24) "3457"
25) "role-reported"
26) "master"
27) "role-reported-time"
28) "103880"
29) "config-epoch"
30) "0"
31) "num-slaves"
32) "0"
33) "num-other-sentinels"
34) "2"
35) "quorum"
36) "2"
37) "failover-timeout"
38) "60000"
39) "parallel-syncs"
40) "1"

127.0.0.1:5000> SENTINEL get-master-addr-by-name mymaster
1) "192.168.2.104"
2) "6379"

127.0.0.1:5000> SENTINEL sentinels mymaster
1)  1) "name"
    2) "ea6cbec52f9c04c6c325414a05562a69b503129c"
    3) "ip"
    4) "192.168.2.166"
    5) "port"
    6) "5000"
    7) "runid"
    8) "ea6cbec52f9c04c6c325414a05562a69b503129c"
    9) "flags"
   10) "sentinel"
   11) "link-pending-commands"
   12) "0"
   13) "link-refcount"
   14) "1"
   15) "last-ping-sent"
   16) "0"
   17) "last-ok-ping-reply"
   18) "241"
   19) "last-ping-reply"
   20) "241"
   21) "down-after-milliseconds"
   22) "5000"
   23) "last-hello-message"
   24) "763"
   25) "voted-leader"
   26) "?"
   27) "voted-leader-epoch"
   28) "0"
2)  1) "name"
    2) "095fc33d13e733d7f974faf0c2b2e6aba015fc3f"
    3) "ip"
    4) "192.168.2.139"
    5) "port"
    6) "5000"
    7) "runid"
    8) "095fc33d13e733d7f974faf0c2b2e6aba015fc3f"
    9) "flags"
   10) "sentinel"
   11) "link-pending-commands"
   12) "0"
   13) "link-refcount"
   14) "1"
   15) "last-ping-sent"
   16) "0"
   17) "last-ok-ping-reply"
   18) "241"
   19) "last-ping-reply"
   20) "241"
   21) "down-after-milliseconds"
   22) "5000"
   23) "last-hello-message"
   24) "425"
   25) "voted-leader"
   26) "?"
   27) "voted-leader-epoch"
   28) "0"

100

101

102

103

104

redis1@redis1:~$ redis-cli -p 5000

127.0.0.1:5000> sentinel master mymaster

1) "name"

2) "mymaster"

3) "ip"

4) "192.168.2.104"

5) "port"

6) "6379"

7) "runid"

8) "4097e9a96cdb74dd4239aede54843e33104e6913"

9) "flags"

10) "master"

11) "link-pending-commands"

12) "0"

13) "link-refcount"

14) "1"

15) "last-ping-sent"

16) "0"

17) "last-ok-ping-reply"

18) "244"

19) "last-ping-reply"

20) "244"

21) "down-after-milliseconds"

22) "5000"

23) "info-refresh"

24) "3457"

25) "role-reported"

26) "master"

27) "role-reported-time"

28) "103880"

29) "config-epoch"

30) "0"

31) "num-slaves"

32) "0"

33) "num-other-sentinels"

34) "2"

35) "quorum"

36) "2"

37) "failover-timeout"

38) "60000"

39) "parallel-syncs"

40) "1"

127.0.0.1:5000> SENTINEL get-master-addr-by-name mymaster

1) "192.168.2.104"

2) "6379"

127.0.0.1:5000> SENTINEL sentinels mymaster

1) 1) "name"

2) "ea6cbec52f9c04c6c325414a05562a69b503129c"

3) "ip"

4) "192.168.2.166"

5) "port"

6) "5000"

7) "runid"

8) "ea6cbec52f9c04c6c325414a05562a69b503129c"

9) "flags"

10) "sentinel"

11) "link-pending-commands"

12) "0"

13) "link-refcount"

14) "1"

15) "last-ping-sent"

16) "0"

17) "last-ok-ping-reply"

18) "241"

19) "last-ping-reply"

20) "241"

21) "down-after-milliseconds"

22) "5000"

23) "last-hello-message"

24) "763"

25) "voted-leader"

26) "?"

27) "voted-leader-epoch"

28) "0"

2) 1) "name"

2) "095fc33d13e733d7f974faf0c2b2e6aba015fc3f"

3) "ip"

4) "192.168.2.139"

5) "port"

6) "5000"

7) "runid"

8) "095fc33d13e733d7f974faf0c2b2e6aba015fc3f"

9) "flags"

10) "sentinel"

11) "link-pending-commands"

12) "0"

13) "link-refcount"

14) "1"

15) "last-ping-sent"

16) "0"

17) "last-ok-ping-reply"

18) "241"

19) "last-ping-reply"

20) "241"

21) "down-after-milliseconds"

22) "5000"

23) "last-hello-message"

24) "425"

25) "voted-leader"

26) "?"

27) "voted-leader-epoch"

28) "0"

redis2


redis1@redis1:~$ redis-cli -h 192.168.2.166 -p 5000
192.168.2.166:5000> sentinel master mymaster
 1) "name"
 2) "mymaster"
 3) "ip"
 4) "192.168.2.104"
 5) "port"
 6) "6379"
 7) "runid"
 8) "4097e9a96cdb74dd4239aede54843e33104e6913"
 9) "flags"
10) "master"
11) "link-pending-commands"
12) "0"
13) "link-refcount"
14) "1"
15) "last-ping-sent"
16) "0"
17) "last-ok-ping-reply"
18) "979"
19) "last-ping-reply"
20) "979"
21) "down-after-milliseconds"
22) "5000"
23) "info-refresh"
24) "8165"
25) "role-reported"
26) "master"
27) "role-reported-time"
28) "188616"
29) "config-epoch"
30) "0"
31) "num-slaves"
32) "0"
33) "num-other-sentinels"
34) "2"
35) "quorum"
36) "2"
37) "failover-timeout"
38) "60000"
39) "parallel-syncs"
40) "1"
192.168.2.166:5000> SENTINEL sentinels mymaster
1)  1) "name"
    2) "095fc33d13e733d7f974faf0c2b2e6aba015fc3f"
    3) "ip"
    4) "192.168.2.139"
    5) "port"
    6) "5000"
    7) "runid"
    8) "095fc33d13e733d7f974faf0c2b2e6aba015fc3f"
    9) "flags"
   10) "sentinel"
   11) "link-pending-commands"
   12) "0"
   13) "link-refcount"
   14) "1"
   15) "last-ping-sent"
   16) "0"
   17) "last-ok-ping-reply"
   18) "855"
   19) "last-ping-reply"
   20) "855"
   21) "down-after-milliseconds"
   22) "5000"
   23) "last-hello-message"
   24) "166"
   25) "voted-leader"
   26) "?"
   27) "voted-leader-epoch"
   28) "0"
2)  1) "name"
    2) "9a7a4e3269530706fd1002c3018a3f0c525c25d6"
    3) "ip"
    4) "192.168.2.104"
    5) "port"
    6) "5000"
    7) "runid"
    8) "9a7a4e3269530706fd1002c3018a3f0c525c25d6"
    9) "flags"
   10) "sentinel"
   11) "link-pending-commands"
   12) "0"
   13) "link-refcount"
   14) "1"
   15) "last-ping-sent"
   16) "0"
   17) "last-ok-ping-reply"
   18) "855"
   19) "last-ping-reply"
   20) "855"
   21) "down-after-milliseconds"
   22) "5000"
   23) "last-hello-message"
   24) "64"
   25) "voted-leader"
   26) "?"
   27) "voted-leader-epoch"
   28) "0"
192.168.2.166:5000>

100

redis1@redis1:~$ redis-cli -h 192.168.2.166 -p 5000

192.168.2.166:5000> sentinel master mymaster

1) "name"

2) "mymaster"

3) "ip"

4) "192.168.2.104"

5) "port"

6) "6379"

7) "runid"

8) "4097e9a96cdb74dd4239aede54843e33104e6913"

9) "flags"

10) "master"

11) "link-pending-commands"

12) "0"

13) "link-refcount"

14) "1"

15) "last-ping-sent"

16) "0"

17) "last-ok-ping-reply"

18) "979"

19) "last-ping-reply"

20) "979"

21) "down-after-milliseconds"

22) "5000"

23) "info-refresh"

24) "8165"

25) "role-reported"

26) "master"

27) "role-reported-time"

28) "188616"

29) "config-epoch"

30) "0"

31) "num-slaves"

32) "0"

33) "num-other-sentinels"

34) "2"

35) "quorum"

36) "2"

37) "failover-timeout"

38) "60000"

39) "parallel-syncs"

40) "1"

192.168.2.166:5000> SENTINEL sentinels mymaster

1) 1) "name"

2) "095fc33d13e733d7f974faf0c2b2e6aba015fc3f"

3) "ip"

4) "192.168.2.139"

5) "port"

6) "5000"

7) "runid"

8) "095fc33d13e733d7f974faf0c2b2e6aba015fc3f"

9) "flags"

10) "sentinel"

11) "link-pending-commands"

12) "0"

13) "link-refcount"

14) "1"

15) "last-ping-sent"

16) "0"

17) "last-ok-ping-reply"

18) "855"

19) "last-ping-reply"

20) "855"

21) "down-after-milliseconds"

22) "5000"

23) "last-hello-message"

24) "166"

25) "voted-leader"

26) "?"

27) "voted-leader-epoch"

28) "0"

2) 1) "name"

2) "9a7a4e3269530706fd1002c3018a3f0c525c25d6"

3) "ip"

4) "192.168.2.104"

5) "port"

6) "5000"

7) "runid"

8) "9a7a4e3269530706fd1002c3018a3f0c525c25d6"

9) "flags"

10) "sentinel"

11) "link-pending-commands"

12) "0"

13) "link-refcount"

14) "1"

15) "last-ping-sent"

16) "0"

17) "last-ok-ping-reply"

18) "855"

19) "last-ping-reply"

20) "855"

21) "down-after-milliseconds"

22) "5000"

23) "last-hello-message"

24) "64"

25) "voted-leader"

26) "?"

27) "voted-leader-epoch"

28) "0"

192.168.2.166:5000>

redis3


redis1@redis1:~$ redis-cli -h 192.168.2.139 -p 5000
192.168.2.139:5000> sentinel master mymaster
 1) "name"
 2) "mymaster"
 3) "ip"
 4) "192.168.2.104"
 5) "port"
 6) "6379"
 7) "runid"
 8) "4097e9a96cdb74dd4239aede54843e33104e6913"
 9) "flags"
10) "master"
11) "link-pending-commands"
12) "0"
13) "link-refcount"
14) "1"
15) "last-ping-sent"
16) "0"
17) "last-ok-ping-reply"
18) "571"
19) "last-ping-reply"
20) "571"
21) "down-after-milliseconds"
22) "5000"
23) "info-refresh"
24) "8363"
25) "role-reported"
26) "master"
27) "role-reported-time"
28) "239355"
29) "config-epoch"
30) "0"
31) "num-slaves"
32) "0"
33) "num-other-sentinels"
34) "2"
35) "quorum"
36) "2"
37) "failover-timeout"
38) "60000"
39) "parallel-syncs"
40) "1"
192.168.2.139:5000> SENTINEL sentinels mymaster
1)  1) "name"
    2) "9a7a4e3269530706fd1002c3018a3f0c525c25d6"
    3) "ip"
    4) "192.168.2.104"
    5) "port"
    6) "5000"
    7) "runid"
    8) "9a7a4e3269530706fd1002c3018a3f0c525c25d6"
    9) "flags"
   10) "sentinel"
   11) "link-pending-commands"
   12) "0"
   13) "link-refcount"
   14) "1"
   15) "last-ping-sent"
   16) "0"
   17) "last-ok-ping-reply"
   18) "232"
   19) "last-ping-reply"
   20) "232"
   21) "down-after-milliseconds"
   22) "5000"
   23) "last-hello-message"
   24) "753"
   25) "voted-leader"
   26) "?"
   27) "voted-leader-epoch"
   28) "0"
2)  1) "name"
    2) "ea6cbec52f9c04c6c325414a05562a69b503129c"
    3) "ip"
    4) "192.168.2.166"
    5) "port"
    6) "5000"
    7) "runid"
    8) "ea6cbec52f9c04c6c325414a05562a69b503129c"
    9) "flags"
   10) "sentinel"
   11) "link-pending-commands"
   12) "0"
   13) "link-refcount"
   14) "1"
   15) "last-ping-sent"
   16) "0"
   17) "last-ok-ping-reply"
   18) "232"
   19) "last-ping-reply"
   20) "232"
   21) "down-after-milliseconds"
   22) "5000"
   23) "last-hello-message"
   24) "1740"
   25) "voted-leader"
   26) "?"
   27) "voted-leader-epoch"
   28) "0"

redis1@redis1:~$ redis-cli -h 192.168.2.139 -p 5000

192.168.2.139:5000> sentinel master mymaster

1) "name"

2) "mymaster"

3) "ip"

4) "192.168.2.104"

5) "port"

6) "6379"

7) "runid"

8) "4097e9a96cdb74dd4239aede54843e33104e6913"

9) "flags"

10) "master"

11) "link-pending-commands"

12) "0"

13) "link-refcount"

14) "1"

15) "last-ping-sent"

16) "0"

17) "last-ok-ping-reply"

18) "571"

19) "last-ping-reply"

20) "571"

21) "down-after-milliseconds"

22) "5000"

23) "info-refresh"

24) "8363"

25) "role-reported"

26) "master"

27) "role-reported-time"

28) "239355"

29) "config-epoch"

30) "0"

31) "num-slaves"

32) "0"

33) "num-other-sentinels"

34) "2"

35) "quorum"

36) "2"

37) "failover-timeout"

38) "60000"

39) "parallel-syncs"

40) "1"

192.168.2.139:5000> SENTINEL sentinels mymaster

1) 1) "name"

2) "9a7a4e3269530706fd1002c3018a3f0c525c25d6"

3) "ip"

4) "192.168.2.104"

5) "port"

6) "5000"

7) "runid"

8) "9a7a4e3269530706fd1002c3018a3f0c525c25d6"

9) "flags"

10) "sentinel"

11) "link-pending-commands"

12) "0"

13) "link-refcount"

14) "1"

15) "last-ping-sent"

16) "0"

17) "last-ok-ping-reply"

18) "232"

19) "last-ping-reply"

20) "232"

21) "down-after-milliseconds"

22) "5000"

23) "last-hello-message"

24) "753"

25) "voted-leader"

26) "?"

27) "voted-leader-epoch"

28) "0"

2) 1) "name"

2) "ea6cbec52f9c04c6c325414a05562a69b503129c"

3) "ip"

4) "192.168.2.166"

5) "port"

6) "5000"

7) "runid"

8) "ea6cbec52f9c04c6c325414a05562a69b503129c"

9) "flags"

10) "sentinel"

11) "link-pending-commands"

12) "0"

13) "link-refcount"

14) "1"

15) "last-ping-sent"

16) "0"

17) "last-ok-ping-reply"

18) "232"

19) "last-ping-reply"

20) "232"

21) "down-after-milliseconds"

22) "5000"

23) "last-hello-message"

24) "1740"

25) "voted-leader"

26) "?"

27) "voted-leader-epoch"

28) "0"

3.测试故障迁移

模拟主节点挂掉30s或者直接关掉服务,可以看到自动选主，并且修改slave的指向(redis2日志)

见加粗部分


sudo service redis-server stop
redis-cli -p 6379 DEBUG sleep 30

sudo service redis-server stop

redis-cli -p 6379 DEBUG sleep 30


redis1@redis1:~$ redis-sentinel sentinel.conf
3450:X 27 Nov 2022 12:23:13.821 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
3450:X 27 Nov 2022 12:23:13.821 # Redis version=7.0.5, bits=64, commit=00000000, modified=0, pid=3450, just started
3450:X 27 Nov 2022 12:23:13.821 # Configuration loaded
3450:X 27 Nov 2022 12:23:13.822 * Increased maximum number of open files to 10032 (it was originally set to 1024).
3450:X 27 Nov 2022 12:23:13.823 * monotonic clock: POSIX clock_gettime
                _._
           _.-``__ ''-._
      _.-``    `.  `_.  ''-._           Redis 7.0.5 (00000000/0) 64 bit
  .-`` .-```.  ```\/    _.,_ ''-._
 (    '      ,       .-`  | `,    )     Running in sentinel mode
 |`-._`-...-` __...-.``-._|'` _.-'|     Port: 5000
 |    `-._   `._    /     _.-'    |     PID: 3450
  `-._    `-._  `-./  _.-'    _.-'
 |`-._`-._    `-.__.-'    _.-'_.-'|
 |    `-._`-._        _.-'_.-'    |           https://redis.io
  `-._    `-._`-.__.-'_.-'    _.-'
 |`-._`-._    `-.__.-'    _.-'_.-'|
 |    `-._`-._        _.-'_.-'    |
  `-._    `-._`-.__.-'_.-'    _.-'
      `-._    `-.__.-'    _.-'
          `-._        _.-'
              `-.__.-'

3450:X 27 Nov 2022 12:23:13.826 # Sentinel ID is 9a7a4e3269530706fd1002c3018a3f0c525c25d6
3450:X 27 Nov 2022 12:23:13.826 # +monitor master mymaster 192.168.2.104 6379 quorum 2
3450:X 27 Nov 2022 12:23:13.829 * +slave slave 192.168.2.139:6379 192.168.2.139 6379 @ mymaster 192.168.2.104 6379
3450:X 27 Nov 2022 12:23:13.832 * Sentinel new configuration saved on disk
3450:X 27 Nov 2022 12:23:13.832 * +slave slave 192.168.2.166:6379 192.168.2.166 6379 @ mymaster 192.168.2.104 6379
3450:X 27 Nov 2022 12:23:13.836 * Sentinel new configuration saved on disk
3450:X 27 Nov 2022 12:23:18.844 # +sdown sentinel 095fc33d13e733d7f974faf0c2b2e6aba015fc3f 192.168.2.139 5000 @ mymaster 192.168.2.104 6379
3450:X 27 Nov 2022 12:23:18.844 # +sdown sentinel ea6cbec52f9c04c6c325414a05562a69b503129c 192.168.2.166 5000 @ mymaster 192.168.2.104 6379
3450:X 27 Nov 2022 12:23:25.263 # -sdown sentinel ea6cbec52f9c04c6c325414a05562a69b503129c 192.168.2.166 5000 @ mymaster 192.168.2.104 6379
3450:X 27 Nov 2022 12:23:37.694 # -sdown sentinel 095fc33d13e733d7f974faf0c2b2e6aba015fc3f 192.168.2.139 5000 @ mymaster 192.168.2.104 6379
3450:X 27 Nov 2022 12:26:23.114 # +sdown master mymaster 192.168.2.104 6379
3450:X 27 Nov 2022 12:26:23.191 # +odown master mymaster 192.168.2.104 6379 #quorum 3/2
3450:X 27 Nov 2022 12:26:23.192 # +new-epoch 4
<strong>3450:X 27 Nov 2022 12:26:23.192 # +try-failover master mymaster 192.168.2.104 6379
3450:X 27 Nov 2022 12:26:23.197 * Sentinel new configuration saved on disk
3450:X 27 Nov 2022 12:26:23.197 # +vote-for-leader 9a7a4e3269530706fd1002c3018a3f0c525c25d6 4
3450:X 27 Nov 2022 12:26:23.200 # ea6cbec52f9c04c6c325414a05562a69b503129c voted for ea6cbec52f9c04c6c325414a05562a69b503129c 4
3450:X 27 Nov 2022 12:26:23.204 # 095fc33d13e733d7f974faf0c2b2e6aba015fc3f voted for ea6cbec52f9c04c6c325414a05562a69b503129c 4
3450:X 27 Nov 2022 12:26:24.346 # +config-update-from sentinel ea6cbec52f9c04c6c325414a05562a69b503129c 192.168.2.166 5000 @ mymaster 192.168.2.104 6379
3450:X 27 Nov 2022 12:26:24.346 # +switch-master mymaster 192.168.2.104 6379 192.168.2.139 6379
3450:X 27 Nov 2022 12:26:24.348 * +slave slave 192.168.2.166:6379 192.168.2.166 6379 @ mymaster 192.168.2.139 6379
3450:X 27 Nov 2022 12:26:24.349 * +slave slave 192.168.2.104:6379 192.168.2.104 6379 @ mymaster 192.168.2.139 6379
3450:X 27 Nov 2022 12:26:24.357 * Sentinel new configuration saved on disk
3450:X 27 Nov 2022 12:26:29.371 # +sdown slave 192.168.2.104:6379 192.168.2.104 6379 @ mymaster 192.168.2.139 6379</strong>

redis1@redis1:~$ redis-sentinel sentinel.conf

3450:X 27 Nov 2022 12:23:13.821 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo

3450:X 27 Nov 2022 12:23:13.821 # Redis version=7.0.5, bits=64, commit=00000000, modified=0, pid=3450, just started

3450:X 27 Nov 2022 12:23:13.821 # Configuration loaded

3450:X 27 Nov 2022 12:23:13.822 * Increased maximum number of open files to 10032 (it was originally set to 1024).

3450:X 27 Nov 2022 12:23:13.823 * monotonic clock: POSIX clock_gettime

_._

_.-``__ ''-._

_.-`` `. `_. ''-._ Redis 7.0.5 (00000000/0) 64 bit

.-`` .-```. ```\/ _.,_ ''-._

( ' , .-` | `, ) Running in sentinel mode

|`-._`-...-` __...-.``-._|'` _.-'| Port: 5000

| `-._ `._ / _.-' | PID: 3450

`-._ `-._ `-./ _.-' _.-'

|`-._`-._ `-.__.-' _.-'_.-'|

| `-._`-._ _.-'_.-' | https://redis.io

`-._ `-._`-.__.-'_.-' _.-'

|`-._`-._ `-.__.-' _.-'_.-'|

| `-._`-._ _.-'_.-' |

`-._ `-._`-.__.-'_.-' _.-'

`-._ `-.__.-' _.-'

`-._ _.-'

`-.__.-'

3450:X 27 Nov 2022 12:23:13.826 # Sentinel ID is 9a7a4e3269530706fd1002c3018a3f0c525c25d6

3450:X 27 Nov 2022 12:23:13.826 # +monitor master mymaster 192.168.2.104 6379 quorum 2

3450:X 27 Nov 2022 12:23:13.829 * +slave slave 192.168.2.139:6379 192.168.2.139 6379 @ mymaster 192.168.2.104 6379

3450:X 27 Nov 2022 12:23:13.832 * Sentinel new configuration saved on disk

3450:X 27 Nov 2022 12:23:13.832 * +slave slave 192.168.2.166:6379 192.168.2.166 6379 @ mymaster 192.168.2.104 6379

3450:X 27 Nov 2022 12:23:13.836 * Sentinel new configuration saved on disk

3450:X 27 Nov 2022 12:23:18.844 # +sdown sentinel 095fc33d13e733d7f974faf0c2b2e6aba015fc3f 192.168.2.139 5000 @ mymaster 192.168.2.104 6379

3450:X 27 Nov 2022 12:23:18.844 # +sdown sentinel ea6cbec52f9c04c6c325414a05562a69b503129c 192.168.2.166 5000 @ mymaster 192.168.2.104 6379

3450:X 27 Nov 2022 12:23:25.263 # -sdown sentinel ea6cbec52f9c04c6c325414a05562a69b503129c 192.168.2.166 5000 @ mymaster 192.168.2.104 6379

3450:X 27 Nov 2022 12:23:37.694 # -sdown sentinel 095fc33d13e733d7f974faf0c2b2e6aba015fc3f 192.168.2.139 5000 @ mymaster 192.168.2.104 6379

3450:X 27 Nov 2022 12:26:23.114 # +sdown master mymaster 192.168.2.104 6379

3450:X 27 Nov 2022 12:26:23.191 # +odown master mymaster 192.168.2.104 6379 #quorum 3/2

3450:X 27 Nov 2022 12:26:23.192 # +new-epoch 4

<strong>3450:X 27 Nov 2022 12:26:23.192 # +try-failover master mymaster 192.168.2.104 6379

3450:X 27 Nov 2022 12:26:23.197 * Sentinel new configuration saved on disk

3450:X 27 Nov 2022 12:26:23.197 # +vote-for-leader 9a7a4e3269530706fd1002c3018a3f0c525c25d6 4

3450:X 27 Nov 2022 12:26:23.200 # ea6cbec52f9c04c6c325414a05562a69b503129c voted for ea6cbec52f9c04c6c325414a05562a69b503129c 4

3450:X 27 Nov 2022 12:26:23.204 # 095fc33d13e733d7f974faf0c2b2e6aba015fc3f voted for ea6cbec52f9c04c6c325414a05562a69b503129c 4

3450:X 27 Nov 2022 12:26:24.346 # +config-update-from sentinel ea6cbec52f9c04c6c325414a05562a69b503129c 192.168.2.166 5000 @ mymaster 192.168.2.104 6379

3450:X 27 Nov 2022 12:26:24.346 # +switch-master mymaster 192.168.2.104 6379 192.168.2.139 6379

3450:X 27 Nov 2022 12:26:24.348 * +slave slave 192.168.2.166:6379 192.168.2.166 6379 @ mymaster 192.168.2.139 6379

3450:X 27 Nov 2022 12:26:24.349 * +slave slave 192.168.2.104:6379 192.168.2.104 6379 @ mymaster 192.168.2.139 6379

3450:X 27 Nov 2022 12:26:24.357 * Sentinel new configuration saved on disk

3450:X 27 Nov 2022 12:26:29.371 # +sdown slave 192.168.2.104:6379 192.168.2.104 6379 @ mymaster 192.168.2.139 6379</strong>


redis2@redis2:~$ redis-sentinel sentinel.conf
3098:X 27 Nov 2022 12:23:24.963 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
3098:X 27 Nov 2022 12:23:24.963 # Redis version=7.0.5, bits=64, commit=00000000, modified=0, pid=3098, just started
3098:X 27 Nov 2022 12:23:24.963 # Configuration loaded
3098:X 27 Nov 2022 12:23:24.965 * Increased maximum number of open files to 10032 (it was originally set to 1024).
3098:X 27 Nov 2022 12:23:24.965 * monotonic clock: POSIX clock_gettime
                _._
           _.-``__ ''-._
      _.-``    `.  `_.  ''-._           Redis 7.0.5 (00000000/0) 64 bit
  .-`` .-```.  ```\/    _.,_ ''-._
 (    '      ,       .-`  | `,    )     Running in sentinel mode
 |`-._`-...-` __...-.``-._|'` _.-'|     Port: 5000
 |    `-._   `._    /     _.-'    |     PID: 3098
  `-._    `-._  `-./  _.-'    _.-'
 |`-._`-._    `-.__.-'    _.-'_.-'|
 |    `-._`-._        _.-'_.-'    |           https://redis.io
  `-._    `-._`-.__.-'_.-'    _.-'
 |`-._`-._    `-.__.-'    _.-'_.-'|
 |    `-._`-._        _.-'_.-'    |
  `-._    `-._`-.__.-'_.-'    _.-'
      `-._    `-.__.-'    _.-'
          `-._        _.-'
              `-.__.-'

3098:X 27 Nov 2022 12:23:24.968 # Sentinel ID is ea6cbec52f9c04c6c325414a05562a69b503129c
3098:X 27 Nov 2022 12:23:24.968 # +monitor master mymaster 192.168.2.104 6379 quorum 2
3098:X 27 Nov 2022 12:23:24.972 * +slave slave 192.168.2.139:6379 192.168.2.139 6379 @ mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:23:24.975 * Sentinel new configuration saved on disk
3098:X 27 Nov 2022 12:23:24.975 * +slave slave 192.168.2.166:6379 192.168.2.166 6379 @ mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:23:24.979 * Sentinel new configuration saved on disk
3098:X 27 Nov 2022 12:23:29.998 # +sdown sentinel 095fc33d13e733d7f974faf0c2b2e6aba015fc3f 192.168.2.139 5000 @ mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:23:37.449 # -sdown sentinel 095fc33d13e733d7f974faf0c2b2e6aba015fc3f 192.168.2.139 5000 @ mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:26:23.136 # +sdown master mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:26:23.237 # +odown master mymaster 192.168.2.104 6379 #quorum 2/2
3098:X 27 Nov 2022 12:26:23.237 # +new-epoch 4
3098:X 27 Nov 2022 12:26:23.237 # +try-failover master mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:26:23.242 * Sentinel new configuration saved on disk
3098:X 27 Nov 2022 12:26:23.242 # +vote-for-leader ea6cbec52f9c04c6c325414a05562a69b503129c 4
3098:X 27 Nov 2022 12:26:23.248 # 9a7a4e3269530706fd1002c3018a3f0c525c25d6 voted for 9a7a4e3269530706fd1002c3018a3f0c525c25d6 4
3098:X 27 Nov 2022 12:26:23.253 # 095fc33d13e733d7f974faf0c2b2e6aba015fc3f voted for ea6cbec52f9c04c6c325414a05562a69b503129c 4
3098:X 27 Nov 2022 12:26:23.333 # +elected-leader master mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:26:23.333 # +failover-state-select-slave master mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:26:23.417 # +selected-slave slave 192.168.2.139:6379 192.168.2.139 6379 @ mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:26:23.417 * +failover-state-send-slaveof-noone slave 192.168.2.139:6379 192.168.2.139 6379 @ mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:26:23.483 * +failover-state-wait-promotion slave 192.168.2.139:6379 192.168.2.139 6379 @ mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:26:24.307 * Sentinel new configuration saved on disk
<strong>3098:X 27 Nov 2022 12:26:24.307 # +promoted-slave slave 192.168.2.139:6379 192.168.2.139 6379 @ mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:26:24.307 # +failover-state-reconf-slaves master mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:26:24.394 * +slave-reconf-sent slave 192.168.2.166:6379 192.168.2.166 6379 @ mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:26:25.322 * +slave-reconf-inprog slave 192.168.2.166:6379 192.168.2.166 6379 @ mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:26:25.323 * +slave-reconf-done slave 192.168.2.166:6379 192.168.2.166 6379 @ mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:26:25.399 # -odown master mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:26:25.399 # +failover-end master mymaster 192.168.2.104 6379
3098:X 27 Nov 2022 12:26:25.399 # +switch-master mymaster 192.168.2.104 6379 192.168.2.139 6379
3098:X 27 Nov 2022 12:26:25.400 * +slave slave 192.168.2.166:6379 192.168.2.166 6379 @ mymaster 192.168.2.139 6379
3098:X 27 Nov 2022 12:26:25.400 * +slave slave 192.168.2.104:6379 192.168.2.104 6379 @ mymaster 192.168.2.139 6379
3098:X 27 Nov 2022 12:26:25.403 * Sentinel new configuration saved on disk
3098:X 27 Nov 2022 12:26:30.447 # +sdown slave 192.168.2.104:6379 192.168.2.104 6379 @ mymaster 192.168.2.139 6379
3098:X 27 Nov 2022 12:29:48.267 # -sdown slave 192.168.2.104:6379 192.168.2.104 6379 @ mymaster 192.168.2.139 6379
3098:X 27 Nov 2022 12:29:58.242 * +convert-to-slave slave 192.168.2.104:6379 192.168.2.104 6379 @ mymaster 192.168.2.139 6379</strong>

redis2@redis2:~$ redis-sentinel sentinel.conf

3098:X 27 Nov 2022 12:23:24.963 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo

3098:X 27 Nov 2022 12:23:24.963 # Redis version=7.0.5, bits=64, commit=00000000, modified=0, pid=3098, just started

3098:X 27 Nov 2022 12:23:24.963 # Configuration loaded

3098:X 27 Nov 2022 12:23:24.965 * Increased maximum number of open files to 10032 (it was originally set to 1024).

3098:X 27 Nov 2022 12:23:24.965 * monotonic clock: POSIX clock_gettime

_._

_.-``__ ''-._

_.-`` `. `_. ''-._ Redis 7.0.5 (00000000/0) 64 bit

.-`` .-```. ```\/ _.,_ ''-._

( ' , .-` | `, ) Running in sentinel mode

|`-._`-...-` __...-.``-._|'` _.-'| Port: 5000

| `-._ `._ / _.-' | PID: 3098

`-._ `-._ `-./ _.-' _.-'

|`-._`-._ `-.__.-' _.-'_.-'|

| `-._`-._ _.-'_.-' | https://redis.io

`-._ `-._`-.__.-'_.-' _.-'

|`-._`-._ `-.__.-' _.-'_.-'|

| `-._`-._ _.-'_.-' |

`-._ `-._`-.__.-'_.-' _.-'

`-._ `-.__.-' _.-'

`-._ _.-'

`-.__.-'

3098:X 27 Nov 2022 12:23:24.968 # Sentinel ID is ea6cbec52f9c04c6c325414a05562a69b503129c

3098:X 27 Nov 2022 12:23:24.968 # +monitor master mymaster 192.168.2.104 6379 quorum 2

3098:X 27 Nov 2022 12:23:24.972 * +slave slave 192.168.2.139:6379 192.168.2.139 6379 @ mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:23:24.975 * Sentinel new configuration saved on disk

3098:X 27 Nov 2022 12:23:24.975 * +slave slave 192.168.2.166:6379 192.168.2.166 6379 @ mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:23:24.979 * Sentinel new configuration saved on disk

3098:X 27 Nov 2022 12:23:29.998 # +sdown sentinel 095fc33d13e733d7f974faf0c2b2e6aba015fc3f 192.168.2.139 5000 @ mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:23:37.449 # -sdown sentinel 095fc33d13e733d7f974faf0c2b2e6aba015fc3f 192.168.2.139 5000 @ mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:26:23.136 # +sdown master mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:26:23.237 # +odown master mymaster 192.168.2.104 6379 #quorum 2/2

3098:X 27 Nov 2022 12:26:23.237 # +new-epoch 4

3098:X 27 Nov 2022 12:26:23.237 # +try-failover master mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:26:23.242 * Sentinel new configuration saved on disk

3098:X 27 Nov 2022 12:26:23.242 # +vote-for-leader ea6cbec52f9c04c6c325414a05562a69b503129c 4

3098:X 27 Nov 2022 12:26:23.248 # 9a7a4e3269530706fd1002c3018a3f0c525c25d6 voted for 9a7a4e3269530706fd1002c3018a3f0c525c25d6 4

3098:X 27 Nov 2022 12:26:23.253 # 095fc33d13e733d7f974faf0c2b2e6aba015fc3f voted for ea6cbec52f9c04c6c325414a05562a69b503129c 4

3098:X 27 Nov 2022 12:26:23.333 # +elected-leader master mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:26:23.333 # +failover-state-select-slave master mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:26:23.417 # +selected-slave slave 192.168.2.139:6379 192.168.2.139 6379 @ mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:26:23.417 * +failover-state-send-slaveof-noone slave 192.168.2.139:6379 192.168.2.139 6379 @ mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:26:23.483 * +failover-state-wait-promotion slave 192.168.2.139:6379 192.168.2.139 6379 @ mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:26:24.307 * Sentinel new configuration saved on disk

<strong>3098:X 27 Nov 2022 12:26:24.307 # +promoted-slave slave 192.168.2.139:6379 192.168.2.139 6379 @ mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:26:24.307 # +failover-state-reconf-slaves master mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:26:24.394 * +slave-reconf-sent slave 192.168.2.166:6379 192.168.2.166 6379 @ mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:26:25.322 * +slave-reconf-inprog slave 192.168.2.166:6379 192.168.2.166 6379 @ mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:26:25.323 * +slave-reconf-done slave 192.168.2.166:6379 192.168.2.166 6379 @ mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:26:25.399 # -odown master mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:26:25.399 # +failover-end master mymaster 192.168.2.104 6379

3098:X 27 Nov 2022 12:26:25.399 # +switch-master mymaster 192.168.2.104 6379 192.168.2.139 6379

3098:X 27 Nov 2022 12:26:25.400 * +slave slave 192.168.2.166:6379 192.168.2.166 6379 @ mymaster 192.168.2.139 6379

3098:X 27 Nov 2022 12:26:25.400 * +slave slave 192.168.2.104:6379 192.168.2.104 6379 @ mymaster 192.168.2.139 6379

3098:X 27 Nov 2022 12:26:25.403 * Sentinel new configuration saved on disk

3098:X 27 Nov 2022 12:26:30.447 # +sdown slave 192.168.2.104:6379 192.168.2.104 6379 @ mymaster 192.168.2.139 6379

3098:X 27 Nov 2022 12:29:48.267 # -sdown slave 192.168.2.104:6379 192.168.2.104 6379 @ mymaster 192.168.2.139 6379

3098:X 27 Nov 2022 12:29:58.242 * +convert-to-slave slave 192.168.2.104:6379 192.168.2.104 6379 @ mymaster 192.168.2.139 6379</strong>

这时候再看master已经变成了redis3


redis1@redis1:~$ redis-cli -p 5000
127.0.0.1:5000> SENTINEL get-master-addr-by-name mymaster
1) "192.168.2.139"
2) "6379"

redis1@redis1:~$ redis-cli -p 5000

127.0.0.1:5000> SENTINEL get-master-addr-by-name mymaster

1) "192.168.2.139"

2) "6379"

去redis3改点数据，去redis2看变不变


redis1@redis1:~$ redis-cli -h 192.168.2.139 -p 6379
192.168.2.139:6379> get test
"1"
192.168.2.139:6379> set test 2
OK
192.168.2.139:6379> get test
"2"
192.168.2.139:6379>
redis1@redis1:~$ redis-cli -h 192.168.2.166 -p 6379
192.168.2.166:6379> get test
"2"
192.168.2.166:6379>

redis1@redis1:~$ redis-cli -h 192.168.2.139 -p 6379

192.168.2.139:6379> get test

"1"

192.168.2.139:6379> set test 2

192.168.2.139:6379> get test

"2"

192.168.2.139:6379>

redis1@redis1:~$ redis-cli -h 192.168.2.166 -p 6379

192.168.2.166:6379> get test

"2"

192.168.2.166:6379>

显然redis3改的值可以从redis2读到，说明复制正常，继续尝试恢复redis1看看能不能读到test=2


redis1@redis1:~$ redis-cli -p 6379
127.0.0.1:6379> get test
"2"
127.0.0.1:6379>

redis1@redis1:~$ redis-cli -p 6379

127.0.0.1:6379> get test

"2"

127.0.0.1:6379>

也可以读到，高可用集群搭建完成

附用到的命令


https://mirrors.tuna.tsinghua.edu.cn

redis1
192.168.2.104
ssh redis1@192.168.2.104

redis2
192.168.2.166
ssh redis2@192.168.2.166

redis3
192.168.2.139
ssh redis3@192.168.2.139

6379

sudo vim /etc/redis/redis.conf
#config all nodes
bind * -::1
protected-mode no

#only in redis2 and redis3
replicaof 192.168.2.104 6379

sudo service redis-server restart


vim sentinel.conf
port 5000 
sentinel monitor mymaster 192.168.2.104 6379 2 
sentinel down-after-milliseconds mymaster 5000 
sentinel failover-timeout mymaster 60000 
sentinel parallel-syncs mymaster 1

redis-sentinel sentinel.conf
redis-cli -p 5000
redis-cli -h 192.168.2.166 -p 5000
redis-cli -h 192.168.2.139 -p 5000

SENTINEL master mymaster 
SENTINEL get-master-addr-by-name mymaster 
SENTINEL replicas mymaster 
SENTINEL sentinels mymaster

redis-cli -p 6379
redis-cli -h 192.168.2.166 -p 6379
redis-cli -h 192.168.2.139 -p 6379

https://mirrors.tuna.tsinghua.edu.cn

redis1

192.168.2.104

ssh redis1@192.168.2.104

redis2

192.168.2.166

ssh redis2@192.168.2.166

redis3

192.168.2.139

ssh redis3@192.168.2.139

6379

sudo vim /etc/redis/redis.conf

#config all nodes

bind * -::1

protected-mode no

#only in redis2 and redis3

replicaof 192.168.2.104 6379

sudo service redis-server restart

vim sentinel.conf

port 5000

sentinel monitor mymaster 192.168.2.104 6379 2

sentinel down-after-milliseconds mymaster 5000

sentinel failover-timeout mymaster 60000

sentinel parallel-syncs mymaster 1

redis-sentinel sentinel.conf

redis-cli -p 5000

redis-cli -h 192.168.2.166 -p 5000

redis-cli -h 192.168.2.139 -p 5000

SENTINEL master mymaster

SENTINEL get-master-addr-by-name mymaster

SENTINEL replicas mymaster

SENTINEL sentinels mymaster

redis-cli -p 6379

redis-cli -h 192.168.2.166 -p 6379

redis-cli -h 192.168.2.139 -p 6379

参考

https://redis.io/docs/

https://redis.io/docs/getting-started/installation/install-redis-on-linux/

https://redis.io/docs/management/replication/

https://redis.io/docs/management/sentinel/