Question

I’m currently teaching myself Haskell, and I’m wondering what the best practices are when working with strings in Haskell.

The default string implementation in Haskell is a list of Char. This is inefficient for file input-output, according to Real World Haskell, since each character is separately allocated (I assume that this means that a String is basically a linked list in Haskell, but I’m not sure.)

But if the default string implementation is inefficient for file i/o, is it also inefficient for working with Strings in memory? Why or why not? C uses an array of char to represent a String, and I assumed that this would be the default way of doing things in most languages.

As I see it, the list implementation of String will take up more memory, since each character will require overhead, and also more time to iterate over, because a pointer dereferencing will be required to get to the next char. But I’ve liked playing with Haskell so far, so I want to believe that the default implementation is efficient.

Answer 1

Best practices for working with strings performantly in Haskell are basically: Use Data.ByteString/Data.ByteString.Lazy.

http://hackage.haskell.org/packages/archive/bytestring/latest/doc/html/

---

As far as the efficiency of the default string implementation goes in Haskell, it’s not. Each Char represents a Unicode codepoint which means it needs at least 21bits per Char.

Since a String is just [Char], that is a linked list of Char, it means Strings have poor locality of reference, and again means that Strings are fairly large in memory, at a minimum it’s N * (21bits + Mbits) where N is the length of the string and M is the size of a pointer (32, 64, what have you) and unlike many other places where Haskell uses lists where other languages might use different structures (I’m thinking specifically of control flow here), Strings are much less likely to be able to be optimized to loops, etc. by the compiler.

And while a Char corresponds to a codepoint, the Haskell 98 report doesn’t specify anything about the encoding used when doing file IO, not even a default much less a way to change it. In practice GHC provides an extensions to do e.g. binary IO, but you’re going off the reservation at that point anyway.

Even with operations like prepending to front of the string it’s unlikely that a String will beat a ByteString in practice.