feat: 增加ClickHouse数据库 (#499)

* feat: 增加ClickHouse数据库

* feat: 增加Kafka中间件
This commit is contained in:
刘瑞斌 2023-11-02 16:33:22 +08:00 committed by GitHub
parent ed2ae51128
commit 42e1f305b5
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
10 changed files with 147 additions and 0 deletions

View File

@ -0,0 +1,16 @@
additionalProperties:
formFields:
- default: 19000
envKey: PANEL_APP_PORT_TCP
labelEn: Port
labelZh: TCP 端口
required: true
rule: paramPort
type: number
- default: 18123
envKey: PANEL_APP_PORT_HTTP
labelEn: Port
labelZh: API 端口
required: true
rule: paramPort
type: number

View File

@ -0,0 +1,23 @@
version: '3'
services:
clickhouse:
container_name: ${CONTAINER_NAME}
restart: always
networks:
- 1panel-network
ports:
- "${PANEL_APP_PORT_HTTP}:8123"
- "${PANEL_APP_PORT_TCP}:9000"
volumes:
- ./clickhouse:/var/lib/clickhouse/
- ./clickhouse-server:/var/log/clickhouse-server/
image: clickhouse/clickhouse-server:23.9.1-alpine
ulimits:
nofile:
soft: 262144
hard: 262144
labels:
createdBy: "Apps"
networks:
1panel-network:
external: true

21
apps/clickhouse/README.md Normal file
View File

@ -0,0 +1,21 @@
# ClickHouse
ClickHouse 一个用于联机分析(OLAP)的列式数据库管理系统(DBMS)
## 主要功能:
- 真正的列式数据库管理系统
- 数据压缩
- 数据的磁盘存储
- 多核心并行处理
- 多服务器分布式处理
- 支持SQL
- 向量引擎
- 实时的数据更新
- 索引
- 适合在线查询
- 支持近似计算
- 自适应连接算法
- 支持数据复制和数据完整性
- 角色的访问控制

19
apps/clickhouse/data.yml Normal file
View File

@ -0,0 +1,19 @@
name: ClickHouse
tags:
- 数据库
title: ClickHouse 一个用于联机分析(OLAP)的列式数据库管理系统(DBMS)
type: 数据库
description: ClickHouse 是一个用于联机分析(OLAP)的列式数据库管理系统(DBMS)
additionalProperties:
key: clickhouse
name: ClickHouse
tags:
- Database
shortDescZh: ClickHouse 一个用于联机分析(OLAP)的列式数据库管理系统(DBMS)
shortDescEn: ClickHouse® is a high-performance, column-oriented SQL database management system (DBMS) for online analytical processing (OLAP).
type: runtime
crossVersionUpdate: false
limit: 0
website: https://clickhouse.com/
github: https://github.com/ClickHouse/ClickHouse
document: https://clickhouse.com/docs/zh

BIN
apps/clickhouse/logo.png Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 321 B

10
apps/kafka/3.6.0/data.yml Normal file
View File

@ -0,0 +1,10 @@
additionalProperties:
formFields:
- default: 9092
envKey: KAFKA_PORT
labelEn: Port
labelZh: TCP 端口
required: true
rule: paramPort
type: number

View File

@ -0,0 +1,30 @@
version: '3'
services:
kafka:
container_name: ${CONTAINER_NAME}
restart: always
environment:
ALLOW_PLAINTEXT_LISTENER: 'yes'
KAFKA_CFG_LOG_RETENTION_MS: 60000
KAFKA_CFG_MAX_REQUEST_SIZE: 524288000
KAFKA_CFG_MESSAGE_MAX_BYTES: 524288000
KAFKA_CFG_REPLICA_FETCH_MAX_BYTES: 524288000
KAFKA_CFG_FETCH_MESSAGE_MAX_BYTES: 524288000
KAFKA_CFG_PARTITION_FETCH_BYTES: 524288000
KAFKA_CFG_NODE_ID: 0
KAFKA_CFG_PROCESS_ROLES: controller,broker
KAFKA_CFG_LISTENERS: PLAINTEXT://:9092,CONTROLLER://:9093
KAFKA_CFG_ADVERTISED_LISTENERS: PLAINTEXT://${CONTAINER_NAME}:${KAFKA_PORT}
KAFKA_CFG_LISTENER_SECURITY_PROTOCOL_MAP: CONTROLLER:PLAINTEXT,PLAINTEXT:PLAINTEXT
KAFKA_CFG_CONTROLLER_QUORUM_VOTERS: 0@127.0.0.1:9093
KAFKA_CFG_CONTROLLER_LISTENER_NAMES: CONTROLLER
networks:
- 1panel-network
ports:
- "${KAFKA_PORT}:9092"
image: bitnami/kafka:3.6.0
labels:
createdBy: "Apps"
networks:
1panel-network:
external: true

9
apps/kafka/README.md Normal file
View File

@ -0,0 +1,9 @@
# Kafka
Kafka 一个分布式流处理平台
## 主要功能:
- 它能够让应用发布或预订数据或事件流。
- 它能够以可容错的持久方式准确地存储记录(即,按照记录的出现顺序)。
- 它能够实时处理记录(一出现便处理)。

19
apps/kafka/data.yml Normal file
View File

@ -0,0 +1,19 @@
name: Kafka
tags:
- 中间件
title: Kafka 一个分布式流处理平台
type: 中间件
description: Kafka 是一个分布式流处理平台
additionalProperties:
key: kafka
name: Kafka
tags:
- Middleware
shortDescZh: Apache Kafka 是一种分布式数据存储,经过优化以实时提取和处理流数据。流数据是指由数千个数据源持续生成的数据,通常可同时发送数据记录。流平台需要处理这些持续流入的数据,按照顺序逐步处理。
shortDescEn: Apache Kafka is a distributed data store optimized for ingesting and processing streaming data in real-time. Streaming data is data that is continuously generated by thousands of data sources, which typically send the data records in simultaneously. A streaming platform needs to handle this constant influx of data, and process the data sequentially and incrementally.
type: tool
crossVersionUpdate: false
limit: 0
website: https://kafka.apache.org/
github: https://github.com/apache/kafka
document: https://kafka.apache.org/documentation/

BIN
apps/kafka/logo.png Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 3.8 KiB