Skip to content

Commit

Permalink
HDDS-11477. [doc] Add configuration description for datanode docs (ap…
Browse files Browse the repository at this point in the history
  • Loading branch information
aierate authored Sep 23, 2024
1 parent 3598ee3 commit 0fcb645
Show file tree
Hide file tree
Showing 2 changed files with 24 additions and 0 deletions.
12 changes: 12 additions & 0 deletions hadoop-hdds/docs/content/concept/Datanodes.md
Original file line number Diff line number Diff line change
Expand Up @@ -76,3 +76,15 @@ blocks that get reported. That is a 40x reduction in the block reports.
This extra indirection helps tremendously with scaling Ozone. SCM has far
less block data to process and the namespace service (Ozone Manager) as a
different service are critical to scaling Ozone.


## Notable configurations

key | default | <div style="width: 300px;">description</div>
----|---------|------------
dfs.container.ratis.datanode.storage.dir | none | This directory is used for storing Ratis metadata like logs.
ozone.scm.datanode.id.dir | none | The path that datanodes will use to store the datanode ID.
hdds.datanode.dir | none | Determines where HDDS data will be stored on the local filesystem.
hdds.datanode.dir.du.reserved | none | Reserved space in bytes per volume. Always leave this much space free for non dfs use.
ozone.metadata.dirs | none | Directory to store persisted data (RocksDB).
ozone.recon.address | 0.0.0.0:9891 | RPC address of the Recon. Use <host:port> to connect Recon.
12 changes: 12 additions & 0 deletions hadoop-hdds/docs/content/concept/Datanodes.zh.md
Original file line number Diff line number Diff line change
Expand Up @@ -49,3 +49,15 @@ Ozone 的存储容器是一个自包含的超级块,容器中包含一系列
SCM 如何获得容器的位置?这一点和现有的 HDFS 十分相似。数据节点会定期发送类似于块报告的容器报告,容器报告比块报告的内容简洁的多,比如,对于一个存储容量为 196 TB 的集群,Ozone 大概会拥有四万个容器,相比于 HDFS 的一百五十万个块,块报告数量缩减为四十分之一。

这种间接管理的方式大大地提高了 Ozone 的扩展性,因为 SCM 需要处理的块数据大大减少,且命名服务(OM)作为一个独特的服务主体对于扩展 Ozone 具有重要意义。


## 需要关注的配置项

配置项 |默认值 | <div style="width:300px;">描述</div>
----|---------|------------
dfs.container.ratis.datanode.storage.dir | none | 该目录用于存储 Ratis 元数据,如日志。
ozone.scm.datanode.id.dir | none | 数据节点上用于存储数据节点 ID 的路径。
hdds.datanode.dir | none | 此配置决定数据节点上的数据将存储在本地文件系统的哪个位置。
hdds.datanode.dir.du.reserved | none | 每个卷保留的存储空间(以字节为单位)。始终为非DFS用途保留这么多空闲空间。
ozone.metadata.dirs | none | 用于存储持久化数据(RocksDB)的目录。
ozone.recon.address | 0.0.0.0:9891 | Recon的RPC地址。 使用 <host:port> 连接到Recon。

0 comments on commit 0fcb645

Please sign in to comment.