Question

I need to perform a simple grep and other manipulations on large files in Java. I am not that familiar with the Java NIO utilities, but I am assuming that is what I need to use. What resources or helpful tips do you have for reading/writing large files. Also, I am working on a SWT application and need to display parts of that data within a text area on a GUI.

Answer 1

java.io.RandomAccessFile uses long for file-pointer offset so should be able to cope. However, you should read a chunk at a time otherwise overheads will be high. FileInputStream works similarly.

Java NIO shouldn’t be too difficult. You don’t need to mess around with Selectors or similar. In fact, prior to JDK7 you can’t select with files. However, avoid mapping files. There is no unmap, so if you try to do it lots you’ll run out of address space on 32-bit systems, or run into other problems (NIO does attempt to call GC, but it’s a bit of a hack).