sqoop增量导入错误

Question

我想使用 sqoop import incremantal 在我的 as400 table 上导入最后的更新，这是我的 sqoop 命令：我确定所有变量，to_porcess_ts 这是一个字符串时间戳 (yyyymmddhhmmss)

sqoop import --verbose --driver $SRC_DRIVER_CLASS --connect $SRC_URL --username $SRC_LOGIN --password $SRC_PASSWORD \
    --table $SRC_TABLE --hive-import --hive-table $SRC_TABLE_HIVE  --target-dir $DST_HDFS \
    --hive-partition-key "to_porcess_ts" --hive-partition-value $current_date --split-by $DST_SPLIT_COLUMN --num-mappers 1 \
    --boundary-query "$DST_QUERY_BOUNDARY" \
    --incremental-append --check-column "to_porcess_ts" --last-value $(hive -e "select max(unix_timestamp(to_porcess_ts, 'ddmmyyyyhhmmss')) from $SRC_TABLE_HIVE"); \
    --compress --compression-codec org.apache.hadoop.io.compress.SnappyCodec

我收到这个错误：

   18/05/14 16:14:18 ERROR tool.BaseSqoopTool: Error parsing arguments for import:
    18/05/14 16:14:18 ERROR tool.BaseSqoopTool: Unrecognized argument: --incremental-append
    18/05/14 16:14:18 ERROR tool.BaseSqoopTool: Unrecognized argument: --check-column
    18/05/14 16:14:18 ERROR tool.BaseSqoopTool: Unrecognized argument: to_porcess_ts
    18/05/14 16:14:18 ERROR tool.BaseSqoopTool: Unrecognized argument: --last-value
    18/05/14 16:14:18 ERROR tool.BaseSqoopTool: Unrecognized argument: -46039745595

Answer 1

删除 ; 或替换此行末尾的 )：

--last-value $(hive -e "select max(unix_timestamp(to_porcess_ts, 'ddmmyyyyhhmmss')) from $SRC_TABLE_HIVE";) \

sqoop增量导入错误

sqoop incremantal import error

sqoop