Logstash JDBC input plugin execution failed with error : Expected one of #, {, } at line 9, column 60

Question

正在通过 logstash 配置文件在 elasticsearch 中插入 oracle table 信息，同时执行 logstash 配置文件并收到以下错误消息。

Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:main, :exception=>"LogStash::ConfigurationError", :message=>"Expected one of #, {, } at line 8, column 84 (byte 334)

请找到我的 JDBC 输入插件

的 logstash 配置

  input {
  jdbc {
    jdbc_driver_library => "D:SearchEngine\data\ojdbc8.jar"
    jdbc_driver_class => "Java::oracle.jdbc.OracleDriver"
    jdbc_connection_string => "jdbc:oracle:thin:@localhost:1521:XE"
    jdbc_user => "vb"
    jdbc_password => "1234567"
    statement => "select vp.id, LISTAGG(vp.code,',')within GROUP(order by vp.code)"CODE", LISTAGG(vbl.product_id,',')within GROUP(order by vbl.product_id)"PRODUCT_ID",LISTAGG(vbl.type,',')within GROUP(order by vbl.type)"TYPE" from product vp,PRODUCT_LINK vbl where vp.id = vbl.product_id group by id,vbl.product_id,vbl.type"
 }
}

output {
  elasticsearch {
    hosts => ["localhost:9200"]
    index => "replacement"
  }
}

请从 logstash 中查找以下错误日志

[2018-06-14T15:42:07,683][ERROR][logstash.agent] Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:main, :exception=>"LogStash::ConfigurationError", :message=>"Expected one of #, {, } at line 8, column 84 (byte 334) after \tinput {\n\t  jdbc {\n\t\tjdbc_driver_library => \"D:\1SearchEngine\data\ojdbc8.jar\"\n\t\tjdbc_driver_class => \"Java::oracle.jdbc.OracleDriver\"\n\t\tjdbc_connection_string => \"jdbc:oracle:thin:@localhost:1521:XE\"\n\t\tjdbc_user => \"vb\"\n\t\tjdbc_password => \"1234567\"\n\t\tstatement => \"select vp.id, LISTSTAGG(vp.code,',')within GROUP(order by vp.code)\"", :backtrace=>["D:/1SearchEngine/logstash-6.2.4/logstash-6.2.4/logstash-core/lib/logstash/compiler.rb:42:in `compile_imperative'",

我正在使用 logstash 6.2.4 版本

我在单行中给出了 SELECT 语句，然后也出现了同样的错误。

statement => "select vp.id, LISTAGG(vp.code,',')within GROUP (order by vp.code)"CODE",LISTAGG(vbl.product_id,' , ')within GROUP(order by vbl.product_id) "PRODUCT_ID",LISTAGG(vbl.type,' , ')within GROUP(order by vbl.type)"TYPE" from product vp,PRODUCT_LINK vbl where vp.id = vbl.product_id group by id,vbl.product_id,vbl.type"

Answer 1

解决方案 1

您需要在双引号内转义双引号。 "SELECT .. \"代码\" ..."

要实现这一点，您需要在 logstash.yml 中 setconfig.support_escapes: true 。（来自 logstash docs）

解决方案 2

使用statement_filepath 从外部文件读取语句。在此外部文件中，您不需要在查询周围加上引号。(See link)

Logstash JDBC input plugin execution failed with error : Expected one of #, {, } at line 9, column 60