Question

I have two files first of which is fizz

#!/usr/bin/python                                                         
import time

print 'started'
time.sleep(3)
print 'ended'

next of which is bar

#!/usr/bin/python                                                         
import sys

for line in sys.stdin:
    print line

When I run the command ./fizz | ./bar I expect it to print started then wait 3 seconds and print ended, but what really happends is that it prints started and ended at the same time after 3 seconds. Is there a way to get my desired behavior? Thanks

Answer 1

Good question. It is a little harder than it should.

The issue is indeed in bar, specifically sys.stdin being buffered. I tried opening sys.stdin with a smaller buffer size and using python -u but that didn’t work. The manpage has this to say:

   -u     Force  stdin,  stdout  and  stderr to be totally unbuffered.  On
          systems where it matters, also put stdin, stdout and  stderr  in
          binary  mode.   Note  that there is internal buffering in xread‐
          lines(), readlines() and file-object  iterators  ("for  line  in
          sys.stdin")  which  is  not  influenced by this option.  To work
          around this, you will want to use "sys.stdin.readline()"  inside
          a "while 1:" loop.

In the end this is what worked for me:

#!/usr/bin/python                                                   
import sys 
import os

while True:
    line = sys.stdin.readline()
    if not line:
        break
    sys.stdout.write(line) # or print, doesn't matter.