Question

I’ve seen how to get a random line from a text file, but the method stated there (the accepted answer) is running horrendously slow. It runs very slowly on my 598KB text file, and still slow on my a version of that text file which has only one out of every 20 lines, at 20KB. I never get past the “a” section (it’s a wordlist).

The original file has 64141 lines; the shortened one has 2138 lines. To generate these files, I took the Linux Mint 11 /usr/share/dict/american-english wordlist and used grep to remove anything with uppercase or an apostrophe (grep -v [[:upper:]] | grep -v \').

The code I’m using is

String result = null;
final Random rand = new Random();
int n = 0;
for (final Scanner sc = new Scanner(wordList); sc.hasNext();) {
    n++;
    if (rand.nextInt(n) == 0) {
    final String line = sc.nextLine();
        boolean isOK = true;
        for (final char c : line.toCharArray()) {
            if (!(constraints.isAllowed(c))) {
                isOK = false;
                break;
            }
        }
        if (isOK) {
            result = line;
        }
        System.out.println(result);
    }
}
return result;

which is slightly adapted from Itay’s answer.

The object constraints is a KeyboardConstraints, which basically has the one method isAllowed(char):

public boolean isAllowed(final char key) {
    if (allAllowed) {
        return true;
    } else {
        return allowedKeys.contains(key);
    }
}

where allowedKeys and allAllowed are provided in the constructor. The constraints variable used here has "aeouhtns".toCharArray() as its allowedKeys with allAllowed off.

Essentially, what I want the method to do is to pick a random word that satisfies the constraints (e.g. for these constraints, “outvote” would work, but not “worker”, because “w” is not in "aeouhtns".toCharArray()).

How can I do this?

Answer 1

You have a bug in your implementation. You should read the line before you choose a random number. Change this:

n++;
if (rand.nextInt(n) == 0) {
    final String line = sc.nextLine();

To this (as in the original answer):

n++;
final String line = sc.nextLine();
if (rand.nextInt(n) == 0) {

You should also check the constraints before drawing a random number. If a line fails the constraints it should be ignored, something like this:

n++;

String line;
do {
    if (!sc.hasNext()) { return result; }
    line = sc.nextLine();
} while (!meetsConstraints(line));

if (rand.nextInt(n) == 0) {
    result = line; 
}