I’m looking for a fast way in C# to find all dates in a string (the string is a big text, I’ve to scan for about 200,000 different strings).
since there are many ways to write date (for example 31/12/2012 or Dec 31, 2012 and much more),
I’m using this Regex (that should cover almost all frequent ways to write dates):
string findDates = “(?:(\d{1,4})- /.-
/.)|(?:(\s\d{1,2})\s+(jan(?:uary){0,1}\.{0,1}|feb(?:ruary){0,1}\.{0,1}|mar(?:ch){0,1}\.{0,1}|apr(?:il){0,1}\.{0,1}|may\.{0,1}|jun(?:e){0,1}\.{0,1}|jul(?:y){0,1}\.{0,1}|aug(?:ust){0,1}\.{0,1}|sep(?:tember){0,1}\.{0,1}|oct(?:ober){0,1}\.{0,1}|nov(?:ember){0,1}\.{0,1}|dec(?:ember){0,1}\.{0,1})\s+(\d{2,4}))|(?:(jan(?:uary){0,1}\.{0,1}|feb(?:ruary){0,1}\.{0,1}|mar(?:ch){0,1}\.{0,1}|apr(?:il){0,1}\.{0,1}|may\.{0,1}|jun(?:e){0,1}\.{0,1}|jul(?:y){0,1}\.{0,1}|aug(?:ust){0,1}\.{0,1}|sep(?:tember){0,1}\.{0,1}|oct(?:ober){0,1}\.{0,1}|nov(?:ember){0,1}\.{0,1}|dec(?:ember){0,1}\.{0,1})\s+([0-9]{1,2})[\s,]+(\d{2,4}))”;
with “RegexOptions.Compiled | RegexOptions.IgnoreCase | RegexOptions.IgnorePatternWhitespace” tags.
also, i tried to pre-compile the regex to make it even more fast.
The problem is that it’s very slow (on some text fies more than 2 seconds)
Is there any better and efficient way to do this?
Thanks
The expression looks good overall, as others have mentioned, it might be a bit verbose with all the
{0,1}instead of?and the(?:instead of applyingRegexOptions.ExplicitCapture. But these shouldn’t make the expression slow. They only result in better readability.What might be causing slowness is the fact that there’s a lot of backtracking options in the expression by making both the expanded month and the . optional. I wonder what would happen if you changed the expression to only apply the optional . once, after the month name, and what would happen if you made the month name a greedy group (
(?>pattern)Nonbacktracking (or “greedy”) subexpression.)So that:
Would become:
Not only is it much shorter, I’d expect it to be faster.
And then there’s the part of the expression at the start, which doesn’t really make sense to me
(?:(\d{1,4})- /.- /.)Either something got lost in the formatting, or this isn’t helping one bit.\d{1,4} would make sense for a year or any other date part, but the
- /.- /.after it doesn’t make sense at all. I think you meant something like:Or something in that area. As it stands it captures garbage, probably not speeding up the matching process.
In the end I agree with Aliostad, that you’re probably better off trying to find a less precise pattern to find initial candidates, then narrow the results using either DateTime.TryParseExact or with an additional set of expressions.
Instead of creating a ‘global’ expression to find candidates, you could use a lot of exact expressions. You’ll see that with Regex it’s often cheaper to run a number of exact expressions over a large input, than running one expression with a lot of |’s and ?’s in there.
So breaking down your search into multiple very exact expressions might result in a lot higher performance, these could be a start:
As you can see all optional groups have been removed from these expressions, making them a lot faster to run. I’ve also removed the exact spelling from the month names, as you probably want to accept ‘sept’ as well as ‘sep’ as well as ‘september’
Breaking up the pattern also improves readability :).
One last tip: limit the amount of possible characters you need to backtrack, by putting a limit on things like \s+, you rarely want 20,000 spaces to match, but if they’re in your source document, it will try to match them. \s{1,20} is usually enough and limits the engines ability to try to get a match where there really isn’t one.