Home/ Questions/Q 862775
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-15T09:11:59+00:00

I have a 1GB binary file on another system. Requirement: ftp/download and convert binary

  • 0

I have a 1GB binary file on another system.

Requirement: ftp/download and convert binary to CSV on main system.

The converted file will be magnitudes larger ~ 8GB

What is the most common way of doing something similar to this?
Should this be a two step independent process, download – then convert?
Should I download small chunks at a time and convert while downloading?

I don’t know the most efficient way to do this…also what should I be cautions of with files this size?

Any advice is appreciated.

Thank You.

(Visual Studio C++)

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    I would write a program that converts the binary format and outputs to CSV format. This program would read from stdin and write to stdout.

    Then I would call

    wget URL_of_remote_binary_file --output-document=- | my_converter_program > output_file.csv

    That way you can start converting immediately (without downloading the entire files) and your program doesn’t deal with networking. You can also run the program on the remote side, assuming it’s portable enough.

    • 0