Home/ Questions/Q 8764965
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-06-13T16:09:59+00:00

I’ve created a windows service that communicates with the Google BigQuery API perfectly using

  • 0

I’ve created a windows service that communicates with the Google BigQuery API perfectly using Service Account authorization. For testing purposes, I’m able to fetch data from a BigQuery table to check communication between my Windows service and the BigQuery API. But this service will basically fetch records from MSSQL server and then one by one will insert or append a record to the target table in BigQuery. I don’t want to use CSV or JSON files as a data source. Is there any way of doing so?

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    No, you’ll have to use either CSV or JSON as a source format to load your data into BigQuery.

    BigQuery currently supports a batch ingestion model, not a record level model. The daily import quota is 1,000 import jobs per table and 10,000 import jobs total for the whole project.

    I would suggest that you export data out of MSSQL server in intervals (perhaps hourly), cache the output in a CSV or JSON file, and then kick off a BigQuery ingestion job after the MSSQL export step is complete.

    • 0