Avoid accessing sys.stdout.buffer when not necessary

Avoid accessing sys.stdout.buffer when not necessary #607