Home/ Questions/Q 968849
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-16T02:32:58+00:00

I wish to have have the following String !cmd 45 90 An argument Another

  • 0

I wish to have have the following String

!cmd 45 90 "An argument" Another AndAnother "Another one in quotes"

to become an array of the following

{ "!cmd", "45", "90", "An argument", "Another", "AndAnother", "Another one in quotes" }

I tried

new StringTokenizer(cmd, "\"")

but this would return “Another” and “AndAnother as “Another AndAnother” which is not the desired effect.

Thanks.

EDIT:
I have changed the example yet again, this time I believe it explains the situation best although it is no different than the second example.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    It’s much easier to use a java.util.regex.Matcher and do a find() rather than any kind of split in these kinds of scenario.

    That is, instead of defining the pattern for the delimiter between the tokens, you define the pattern for the tokens themselves.

    Here’s an example:

        String text = "1 2 \"333 4\" 55 6    \"77\" 8 999";
    // 1 2 "333 4" 55 6    "77" 8 999

    String regex = "\"([^\"]*)\"|(\\S+)";

    Matcher m = Pattern.compile(regex).matcher(text);
    while (m.find()) {
        if (m.group(1) != null) {
            System.out.println("Quoted [" + m.group(1) + "]");
        } else {
            System.out.println("Plain [" + m.group(2) + "]");
        }
    }

    The above prints (as seen on ideone.com):

    Plain [1]
Plain [2]
Quoted [333 4]
Plain [55]
Plain [6]
Quoted [77]
Plain [8]
Plain [999]

    The pattern is essentially:

    "([^"]*)"|(\S+)
 \_____/  \___/
    1       2

    There are 2 alternates:

    • The first alternate matches the opening double quote, a sequence of anything but double quote (captured in group 1), then the closing double quote
    • The second alternate matches any sequence of non-whitespace characters, captured in group 2
    • The order of the alternates matter in this pattern

    Note that this does not handle escaped double quotes within quoted segments. If you need to do this, then the pattern becomes more complicated, but the Matcher solution still works.

    References

    See also

    Appendix

    Note that StringTokenizer is a legacy class. It’s recommended to use java.util.Scanner or String.split, or of course java.util.regex.Matcher for most flexibility.

    Related questions

    • 0