To build the Java version of TsFile Tools, you must have the following dependencies installed:
- Java >= 1.8 (1.8, 11 to 17 are verified. Make sure the environment variable is set).
- Maven >= 3.6 (if you are compiling TsFile from source).
mvn clean package -P with-java -DskipTestsmvn install -P with-java -DskipTests
| Parameter | Description | Required | Default |
|---|---|---|---|
| table_name | Table name | Yes | |
| time_precision | Time precision (options: ms/us/ns) | No | ms |
| has_header | Whether it contains a header (options: true/false) | No | true |
| separator | Delimiter (options: , /tab/ ;) | No | , |
| null_format | Null value | No | |
| id_columns | Primary key columns, supports columns not in the CSV as hierarchy | No | |
| time_column | Time column | Yes | |
| csv_columns | Corresponding columns in the CSV in order | Yes |
Explanation:
The "id_columns" sets values in order and supports using columns that do not exist in the CSV file as levels. For example, if the CSV file has only five columns: "a", "b", "c", "d", and "time", id_columns a1 default aa a Among them, a1 is not in the CSV column and is a virtual column with a default value of aa
The content after csv_columns is the definition of the value column, with the first field in each row being the measurement point name in tsfile and the second field being the type When a column in CSV does not need to be written to tsfile, it can be set to SKIP.
Example: csv_columns Region TEXT, Factory Number TEXT, Device Number TEXT, SKIP, SKIP, Time INT64, Temperature FLOAT, Emission DOUBLE,
Data Example CSV file content:
CSV file content:
Region,FactoryNumber,DeviceNumber,Model,MaintenanceCycle,Time,Temperature,Emission
hebei,1001, 1,10,1,1,80.0,1000.0
hebei,1001,1,10,1,4,80.0,1000.0
hebei,1002,7,5,2,1,90.0,1200.0
Schema definition
table_name=root.db1
time_precision=ms
has_header=true
separator=,
null_format=\N
id_columns
Group DEFAULT Datang
Region
FactoryNumber
DeviceNumber
time_column=Time
csv_columns
RegionTEXT,
FactoryNumber TEXT,
DeviceNumber TEXT,
SKIP,
SKIP,
Time INT64,
Temperature FLOAT,
Emission DOUBLE,
csv2tsfile.sh --source ./xxx/xxx --target /xxx/xxx --fail_dir /xxx/xxx
csv2tsfile.bat --source ./xxx/xxx --target /xxx/xxx --fail_dir /xxx/xxx