GHC.IO.Encoding.Types

base-4.3.1.0: Basic libraries

Portability | non-portable
Stability | internal
Maintainer | libraries@haskell.org

GHC.IO.Encoding.Types

Description

Types for text encoding/decoding

Synopsis

- data BufferCodec from to state = BufferCodec {
  - encode :: Buffer from -> Buffer to -> IO (Buffer from, Buffer to)
  - close :: IO ()
  - getState :: IO state
  - setState :: state -> IO ()
  }
- data TextEncoding = forall dstate estate . TextEncoding {
  - textEncodingName :: String
  - mkTextDecoder :: IO (TextDecoder dstate)
  - mkTextEncoder :: IO (TextEncoder estate)
  }
- type TextEncoder state = BufferCodec CharBufElem Word8 state
- type TextDecoder state = BufferCodec Word8 CharBufElem state
- type EncodeBuffer = Buffer Char -> Buffer Word8 -> IO (Buffer Char, Buffer Word8)
- type DecodeBuffer = Buffer Word8 -> Buffer Char -> IO (Buffer Word8, Buffer Char)

# Documentation

data BufferCodec from to state

Constructors

BufferCodec |
Fields encode :: Buffer from -> Buffer to -> IO (Buffer from, Buffer to) The `encode` function translates elements of the buffer `from` to the buffer `to`. It should translate as many elements as possible given the sizes of the buffers, including translating zero elements if there is either not enough room in `to`, or `from` does not contain a complete multibyte sequence. `encode` should raise an exception if, and only if, `from` begins with an illegal sequence, or the first element of `from` is not representable in the encoding of `to`. That is, if any elements can be successfully translated before an error is encountered, then `encode` should translate as much as it can and not throw an exception. This behaviour is used by the IO library in order to report translation errors at the point they actually occur, rather than when the buffer is translated. close :: IO () Resources associated with the encoding may now be released. The `encode` function may not be called again after calling `close`. getState :: IO state Return the current state of the codec. Many codecs are not stateful, and in these case the state can be represented as '()'. Other codecs maintain a state. For example, UTF-16 recognises a BOM (byte-order-mark) character at the beginning of the input, and remembers thereafter whether to use big-endian or little-endian mode. In this case, the state of the codec would include two pieces of information: whether we are at the beginning of the stream (the BOM only occurs at the beginning), and if not, whether to use the big or little-endian encoding. setState :: state -> IO ()

data TextEncoding

A `TextEncoding` is a specification of a conversion scheme between sequences of bytes and sequences of Unicode characters.

For example, UTF-8 is an encoding of Unicode characters into a sequence of bytes. The `TextEncoding` for UTF-8 is `utf8`.

Constructors

forall dstate estate . TextEncoding |
Fields textEncodingName :: String a string that can be passed to `mkTextEncoding` to create an equivalent `TextEncoding`. mkTextDecoder :: IO (TextDecoder dstate) mkTextEncoder :: IO (TextEncoder estate)

Instances

Show TextEncoding |

type TextEncoder state = BufferCodec CharBufElem Word8 state

type TextDecoder state = BufferCodec Word8 CharBufElem state

type EncodeBuffer = Buffer Char -> Buffer Word8 -> IO (Buffer Char, Buffer Word8)

type DecodeBuffer = Buffer Word8 -> Buffer Char -> IO (Buffer Word8, Buffer Char)