Question

Possible Duplicate:
Why do I get “/bin/sh: Argument list too long” when passing quoted arguments?

I am using awk script inside a shell script and I am processing multiple files and for everytime I am getting the output from awk, processing it in shell and the feeding back the processd thing into awk script again.

But the problem here is, each time the data that is being processed is huge around 30000 lines which I am storing it in a single variable and I am passing into awk using the -v option.

So I am getting an error

/usr/bin/awk: Argument list too long

Any remedy of how to solve this .. And am I clear with the question

Answer 1

You’re trying to pass too many arguments to awk. You shouldn’t use -v to pass arbitrarily large amounts of data; feed it via a pipe to awk‘s standard input instead.

(I can’t show you example code without seeing a snippet of your code, since I don’t fully understand how you’re currently handling your data.)