并行化 awk 脚本

Question

我正在尝试并行化以下脚本：

$ awk -F , ' > 25 &&  < 26' data_temp.csv | head

... 我正在为此获得所需的输出。（cat data_temp.csv | awk -F , ' > 25 && < 26' | head 也是如此。）我目前的尝试：

$ parallel "awk -F , ' > 25 &&  < 26' data_temp.csv" | head
parallel: Warning: Input is read from the terminal.
parallel: Warning: Only experts do this on purpose. Press CTRL-D to exit.

$ cat data_temp.csv | parallel --pipe awk -F , \' > 25 &&  < 26\' | awk -F , ' > 25 &&  < 26' | head
sh: -c: line 0: unexpected EOF while looking for matching `''
sh: -c: line 1: syntax error: unexpected end of file
# repeated for what looks like every line

Answer 1

未测试：

cat data_temp.csv |
  parallel -k -q --block 100M --pipe awk -F , ' > 25 &&  < 26' |
  head
parallel -k -q --block 100M --pipepart -a data_temp.csv awk -F , ' > 25 &&  < 26' |
  head

并行化 awk 脚本

Parallelizing awk script

parallel-processing

bash

awk

gnu-parallel