Data.Iteratee.Parallel

iteratee-0.8.8.1: Iteratee-based I/O

Data.Iteratee.Parallel

Synopsis

- psequence_ :: (ListLike s el, Nullable s) => [Iteratee s IO a] -> Iteratee s IO ()
- parE :: (Nullable s1, Nullable s2, Monoid s1) => Enumeratee s1 s2 IO r -> Enumeratee s1 s2 IO r
- parI :: (Nullable s, Monoid s) => Iteratee s IO a -> Iteratee s IO a
- liftParI :: (Nullable s, Monoid s, MonadIO m) => Iteratee s IO a -> Iteratee s m a
- mapReduce :: (Monad m, Nullable s, Monoid b) => Int -> (s -> b) -> Iteratee s m b

# Documentation

psequence_ :: (ListLike s el, Nullable s) => [Iteratee s IO a] -> Iteratee s IO ()

Enumerate a list of iteratees over a single stream simultaneously and discard the results. Each iteratee runs in a separate forkIO thread, passes all errors from iteratees up.

parE :: (Nullable s1, Nullable s2, Monoid s1) => Enumeratee s1 s2 IO r -> Enumeratee s1 s2 IO r

Transform an Enumeratee into a parallel composable one, introducing one step extra delay, see `parI`.

parI :: (Nullable s, Monoid s) => Iteratee s IO a -> Iteratee s IO a

Transform usual Iteratee into parallel composable one, introducing one step extra delay.

Ex - time spent in Enumerator working on x'th packet Ix - time spent in Iteratee working on x'th packet z - last packet, y = (z-1)'th packet

regular Iteratee: E0 - I0, E1 - I1, E2 - I2 .. Ez -> Iz parallel Iteratee: E0, E1, E2, .. Ez _ I0_ I1_ .. Iy__ Iz

liftParI :: (Nullable s, Monoid s, MonadIO m) => Iteratee s IO a -> Iteratee s m a

A variant of `parI` with the parallelized iteratee lifted into an arbitrary MonadIO.

mapReduce

Arguments

:: (Monad m, Nullable s, Monoid b) |
=> Int | maximum number of chunks to read
-> (s -> b) | map function
-> Iteratee s m b |

Perform a parallel map/reduce. The `bufsize` parameter controls the maximum number of chunks to read at one time. A larger bufsize allows for greater parallelism, but will require more memory.

Implementation of `sum`

     sum :: (Monad m, LL.ListLike s, Nullable s) => Iteratee s m Int64
     sum = getSum <$> mapReduce 4 (Sum . LL.sum)