Skip to content

Database-Resources.md

Latest commit

 

History

History
207 lines (195 loc) · 6.67 KB

Database-Resources.md

File metadata and controls

207 lines (195 loc) · 6.67 KB
Raw

Database Resources

1. CPU

Number of timeseries (frequency<=1HZ) CPU Number of nodes
standalone mode Double active Distributed
Within 100000 2core-4core 1 2 3
Within 300000 4core-8core 1 2 3
Within 500000 8core-26core 1 2 3
Within 1000000 16core-32core 1 2 3
Within 2000000 32core-48core 1 2 3
Within 10000000 48core 1 2 Please contact Timecho Business for consultation
Over 10000000 Please contact Timecho Business for consultation

Supported CPU models: Kunpeng, Phytium, Sunway, Hygon, Zhaoxin, Loongson

2. Memory

Number of timeseries (frequency<=1HZ) Memory Number of nodes
standalone mode Double active Distributed
Within 100000 2G-4G 1 2 3
Within 300000 6G-12G 1 2 3
Within 500000 12G-24G 1 2 3
Within 1000000 24G-48G 1 2 3
Within 2000000 48G-96G 1 2 3
Within 10000000 128G 1 2 Please contact Timecho Business for consultation
Over 10000000 Please contact Timecho Business for consultation

Flexible memory configuration options are provided. Users can adjust them in the datanode-env file. For details and configuration guidelines, please refer to datanode-env

3. Storage (Disk)

3.1 Storage space

Calculation formula: Number of measurement points * Sampling frequency (Hz) * Size of each data point (Byte, different data types may vary, see table below) * Storage time (seconds) * Number of copies (usually 1 copy for a single node and 2 copies for a cluster) ÷ Compression ratio (can be estimated at 5-10 times, but may be higher in actual situations)

Data point size calculation
data type Timestamp (Bytes) Value (Bytes) Total size of data points (in bytes)
Boolean 8 1 9
INT32/FLOAT 8 4 12
INT64/DOUBLE 8 8 16
TEXT 8 The average is a 8+a

Example: 1000 devices, each with 100 measurement points, a total of 100000 sequences, INT32 type. Sampling frequency 1Hz (once per second), storage for 1 year, 3 copies.

  • Complete calculation formula: 1000 devices * 100 measurement points * 12 bytes per data point * 86400 seconds per day * 365 days per year * 3 copies / 10 compression ratio / 1024 / 1024 / 1024 / 1024 =11T
  • Simplified calculation formula: 1000 * 100 * 12 * 86400 * 365 * 3 / 10 / 1024 / 1024 / 1024 / 1024 =11T

3.2 Storage Configuration

If the number of nodes is over 10000000 or the query load is high, it is recommended to configure SSD

4. Network (Network card)

If the write throughput does not exceed 10 million points/second, configure 1Gbps network card. When the write throughput exceeds 10 million points per second, a 10Gbps network card needs to be configured.

Write throughput (data points per second) NIC rate
<10 million 1Gbps
>=10 million 10Gbps

5. Other instructions

IoTDB has the ability to scale up clusters in seconds, and expanding node data does not require migration. Therefore, you do not need to worry about the limited cluster capacity estimated based on existing data. In the future, you can add new nodes to the cluster when you need to scale up.