Home/ Questions/Q 7439395
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-29T10:41:58+00:00

I want to parse data from a log file, pump it into a database,

  • 0

I want to parse data from a log file, pump it into a database, and then purge the log file.

I could use the FileSystemWatcher component, and monitor the Change event, but the event would be firing non-stop, as the log file is pretty much “constantly” being written to. I don’t want to be opening/closing db connections willy-nilly.

My current instinct is to use a Timer, and then parse/pump/purge the log file every so often (based on time or based on time and size of file).

Is there a common/proven way of handling the scenario (design pattern)?

Update: I see FileSystemWatcher has a NotifyFilter property, with one of the filterables being “Size”; I’m guessing (haven’t found any verification yet) that any time the size of the file changes by 1KB it fires; this would be a reasonable “throttle,” if true…

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Not sure if this is a design pattern, but if you control how much you buffer before actually writing to the log file you can minimize the frequency.

    • 0