Stream Processing - Partitioning Your Data

If you're dealing with big data, you'll probably be looking at cofka. You create a number of partitions so that you can spread out the rights andnd. It also allows to process that data in parallel,. So most stream processing technologies out there can work on a partition at a time. But i know specifically for kofka, it writes out two files per partition in a directory.