I’m writing two Django applications: one that generates a lot of data in time, and another part that displays it. The app that generate it will run on a machine at my home and the one that displays the data will be a machine on the internet.
What do you believe it will be the best way to transfer the data from the application that generates the content (SQL entries + documents) to the application that displays it ?
My fist thoughts are to somehow send it though FTP (from code) as a zip payload, and on the display server to have a cron that will periodically process the new payloads and merge the data to the existing one.
Any other ideas? I would prefer python/django
Setup two databases – one master and one slave. Write on the master and make the slave to sync with the master. This way you will not need to worry when your connection is down.