遍历参数 table 和 return 查询结果并集

Question

我有一个 Hive table，我需要运行一个类似于下面的查询以获取不同的参数值 date、identifier1、identifier2、lower 和 upper 并将结果合并在一起。

Select 
col1,
col2,
new_time,
sum(col3),
case 
when "date" between date1 and date2 then 'No'
when "date" between date3 and date4 then 'Yes'
end as date_group,
case when "date" < e then 'test1' else 'test2' end as test_group,
'identifier1' as ID,
'identifier2' as ID2
FROM Table1
WHERE (new_time between time1 and time2)
      AND (tag between 'lower' and 'upper')
GROUP BY 
col1,
col2,
new_time,
case 
when "date" between date1 and date2 then 'No'
when "date" between date3 and date4 then 'Yes'
end,
case when "date" < e then 'test' else 'test2' end

我最初的想法是在下面创建参数 table 并循环遍历包含参数值组合的每一行并合并结果。

+------------+-------------+-------------+--------+-------+
|    date    | identifier1 | identifier2 | lower  | upper |
+------------+-------------+-------------+--------+-------+
| 2019-05-12 |           1 | A           |     10 |    20 |
| 2019-07-10 |           2 | B           |     30 |    40 |
| 2019-04-10 |           3 | C           |     60 |    70 |
| 2019-04-11 |           4 | D           |    423 |   500 |
| 2019-07-10 |           5 | E           |     85 |    88 |
+------------+-------------+-------------+--------+-------+

两个问题，我不确定如何解决这个问题，我不确定 hiveql 是否允许循环。我更喜欢配置单元解决方案，但如果我能够将我的中间 table 移动到关系数据库，SQL 解决方案可能会起作用。一个解决方案相当于下面突出显示参数值的联合查询。

感谢任何有关解决方案的帮助，谢谢。

Answer 1

创建参数 table 并使用联接。我不是 100% 确定哪些是参数，哪些是列，但是是这样的：

SELECT t1.col1, t1.col2, t1.new_time, sum(t1.col3),
       (case when "date" between a and b then 1
             when "date" between c and d then 2
        end) as date_group,
       (case when "date" < e then 'test1' else 'test2' end) as test_group,
      p.identifier as ID,
      p.identifier2 as ID2
FROM Table1 t1 CROSS JOIN
      params p
WHERE t1.new_time BETWEEN t1.time1 AND t1.time2 AND
      t1.tag BETWEEN p.lower AND p.upper
GROUP BY t1.col1, t1.col2, t1.new_time, 
      (case when p."date" between a and b then 1
            when p."date" between c and d then 2
       end),
      (case when p."date" < e then 'test' else 'test2' end),
      p.identifier, p.identifier2;

遍历参数 table 和 return 查询结果并集

Loop through parameter table and return union of query results

sql

hive

hiveql