Doris数据导入及查询执行步骤

原创

lenglingx 2024-10-29 21:14:48 博主文章分类：doris ©著作权

©著作权归作者所有：来自51CTO博客作者lenglingx的原创作品，请联系作者获取转载授权，否则将追究法律责任

一、将本地要导入的数据保存成csv格式，其实就是文本，用逗号分隔。

Doris数据导入及查询执行步骤_sed

二、根据表头在doris创建对应的表


CREATE TABLE `basedata_division_income_quota_001` (
  `id` int NULL,
  `to_owner_division_name` varchar(765) NULL,
  `customer_name` varchar(765) NULL,
  `start_station` varchar(765) NULL,
  `start_station_type` varchar(765) NULL,
  `end_station` varchar(765) NULL,
  `end_station_type` varchar(765) NULL,
  `end_province` varchar(765) NULL,
  `end_city` varchar(765) NULL,
  `end_area` varchar(765) NULL,
  `operation_type_name` varchar(765) NULL,
  `to_vehicle_brand` varchar(765) NULL,
  `to_vehicle_type` varchar(765) NULL,
  `income_per_unit_2024` decimal(20,4) NULL,
  `remark` varchar(765) NULL,
  `income_per_unit_2023` varchar(765) NULL,
  `t_quota_col` varchar(765) NULL
) ENGINE=OLAP
UNIQUE KEY(`id`)
DISTRIBUTED BY HASH(`id`) BUCKETS AUTO
PROPERTIES (
"replication_allocation" = "tag.location.default: 3",
"min_load_replica_num" = "-1",
"is_being_synced" = "false",
"storage_medium" = "hdd",
"storage_format" = "V2",
"inverted_index_storage_format" = "V2",
"enable_unique_key_merge_on_write" = "true",
"light_schema_change" = "true",
"disable_auto_compaction" = "false",
"enable_single_replica_compaction" = "false",
"group_commit_interval_ms" = "10000",
"group_commit_data_bytes" = "134217728",
"enable_mow_light_delete" = "false"
);

三、通过执行curl命令实现数据导入

curl --location-trusted -u root:root__ -T basedata_division_income_quota_001.csv -H "column_separator:," -H "label:basedata_division_income_quota_001_import_test" -H "expect:100-continue" http://192.168.102.241:8030/api/twms/basedata_division_income_quota_001/_stream_load

Doris数据导入及查询执行步骤_sed_02