StoutPanda The Bamboo Grove

HomeLab Revamp Network Plan: Game Plan

Below is initial overview of my plan for implementing the updated network plan to facilitate kubernetes.

Network Topology Overview with VLANs and Ports

Internet
    │
    ▼
UDM-PRO (10.0.1.1)
    │ 
    │ DAC → Port 1 (VLANs: 1,2,3,4,5,6,10,16,18,28,38,48,58)
    ▼
Unifi Enterprise 24 Port (10.0.1.238) - Core Switch
    │
    │ SFP+ → Port 24 (VLANs: 1,16,18,28,38,48,58)
    ▼
Ubiquiti Flex 2.5G (10.0.1.80)
    │
    ├───── Port 1: Uplink to Enterprise 24 Port (Trunk: All VLANs, VLAN 1 native)
    │
    ├───── Port 2-3: MS-01 Node 1 (10.8.16.90) 2.5G ports (VLAN 16 native, VLAN 18 tagged)
    │
    ├───── Port 4-5: MS-01 Node 2 (10.8.16.91) 2.5G ports (VLAN 16 native, VLAN 18 tagged)
    │
    ├───── Port 6: Connection to Flex Mini (VLAN 16 native, VLAN 18 tagged)
    │      │
    │      ▼
    │     Ubiquiti Flex Mini (10.0.1.81)
    │       │
    │       ├── Port 1: Uplink to Flex 2.5G (VLAN 16 native, VLAN 18 tagged)
    │       │
    │       ├── Port 2: K8s-CP-01 (10.8.16.86) (VLAN 16 native, VLAN 18 tagged)
    │       │
    │       ├── Port 3: K8s-CP-02 (10.8.16.87) (VLAN 16 native, VLAN 18 tagged)
    │       │
    │       └── Port 4: K8s-CP-03 (10.8.16.88) (VLAN 16 native, VLAN 18 tagged)
    │
    ├───── Port 7: MikroTik CRS309 Management (VLAN 1 only)
    │      │
    │      ▼
    │     MikroTik CRS309-1G-8S+ (10.0.1.82)
    │       │
    │       ├── Port 1: Management to Flex 2.5G (VLAN 1 only)
    │       │
    │       ├── Port 2-3: MS-01 Node 1 SFP+ (VLANs: 28,38,48)
    │       │
    │       └── Port 4-5: MS-01 Node 2 SFP+ (VLANs: 28,38,48)
    │
    └───── Port 8: Admin Box (10.8.16.85) (VLAN 16 native, VLAN 18 tagged)

VLAN Structure

VLAN ID Purpose Subnet Gateway Notes
16 Kubernetes Management 10.8.16.0/27 10.8.16.1 Native VLAN for K8s components
18 Kubernetes Control Plane 10.8.18.0/27 10.8.18.1 For API server, etcd, scheduler
28 Kubernetes Pod Network 10.8.28.0/23 10.8.28.1 512 IPs for pod allocation
38 Kubernetes Service Network 10.8.38.0/26 10.8.38.1 64 IPs for Kubernetes services
48 Storage Network 10.8.48.0/27 10.8.48.1 Dedicated for Ceph traffic
58 Load Balancer IPs 10.8.58.0/27 10.8.58.1 32 IPs for external service access

Mermaid Diagram

graph TD
    %% VLAN information - positioned at the top
    subgraph "VLAN Structure"
        VLAN1["VLAN 1: Management (10.0.1.0/24)"]
        VLAN16["VLAN 16: K8s Management (10.8.16.0/27)"]
        VLAN18["VLAN 18: K8s Control Plane (10.8.18.0/27)"]
        VLAN28["VLAN 28: K8s Pod Network (10.8.28.0/23)"]
        VLAN38["VLAN 38: K8s Service Network (10.8.38.0/26)"]
        VLAN48["VLAN 48: Storage Network (10.8.48.0/27)"]
        VLAN58["VLAN 58: Load Balancer Network (10.8.58.0/27)"]
    end
    
    %% Main network path
    Internet[Internet] --> UDMPRO[UDM-PRO\n10.0.1.1]
    UDMPRO --"DAC → Port 1\nVLANs: 1,2,3,4,5,6,10,16,18,28,38,48,58"--> Enterprise24["Unifi Enterprise 24 Port\n10.0.1.238"]
    Enterprise24 --"SFP+ → Port 24\nVLANs: 1,16,18,28,38,48,58"--> UbiquitiFlex25G["Ubiquiti Flex 2.5G\n10.0.1.80"]
    
    %% Flex 2.5G connections
    UbiquitiFlex25G --"Port 2-3\nVLAN 16 native, VLAN 18 tagged"--> MS01Node1["MS-01 Node 1\n10.8.16.90"]
    UbiquitiFlex25G --"Port 4-5\nVLAN 16 native, VLAN 18 tagged"--> MS01Node2["MS-01 Node 2\n10.8.16.91"]
    UbiquitiFlex25G --"Port 6\nVLAN 16 native, VLAN 18 tagged"--> UbiquitiFlexMini["Ubiquiti Flex Mini\n10.0.1.81"]
    UbiquitiFlex25G --"Port 7\nVLAN 1 only"--> MikroTikCRS309["MikroTik CRS309-1G-8S+\n10.0.1.82"]
    UbiquitiFlex25G --"Port 8\nVLAN 16 native, VLAN 18 tagged"--> AdminBox["Admin Box\n10.8.16.85"]
    
    %% Flex Mini connections
    UbiquitiFlexMini --"Port 2\nVLAN 16 native, VLAN 18 tagged"--> K8sCP01["K8s-CP-01\n10.8.16.86"]
    UbiquitiFlexMini --"Port 3\nVLAN 16 native, VLAN 18 tagged"--> K8sCP02["K8s-CP-02\n10.8.16.87"]
    UbiquitiFlexMini --"Port 4\nVLAN 16 native, VLAN 18 tagged"--> K8sCP03["K8s-CP-03\n10.8.16.88"]
    
    %% MikroTik connections
    MikroTikCRS309 --"Port 2-3\nVLANs: 28,38,48"--> MS01Node1SFP["MS-01 Node 1 SFP+"]
    MikroTikCRS309 --"Port 4-5\nVLANs: 28,38,48"--> MS01Node2SFP["MS-01 Node 2 SFP+"]
    

    
    %% Device-type styling
    classDef router fill:#f96,stroke:#333,stroke-width:2px
    classDef switch fill:#69b,stroke:#333,stroke-width:2px
    classDef client fill:#ddd,stroke:#333,stroke-width:1px
    classDef vlan fill:#e8f4f8,stroke:#333,stroke-width:1px,stroke-dasharray: 5 5
    
    %% Apply classes
    class UDMPRO router
    class Enterprise24,UbiquitiFlex25G,UbiquitiFlexMini,MikroTikCRS309 switch
    class MS01Node1,MS01Node2,K8sCP01,K8sCP02,K8sCP03,AdminBox,MS01Node1SFP,MS01Node2SFP client
    class VLAN1,VLAN16,VLAN18,VLAN28,VLAN38,VLAN48,VLAN58 vlan