High speed file splitter: A solution to address data split need for parallel processing
Prabin Ranjan Sahoo, Chetan Phalak · 2011
As the IT industry enters into a new phase of technology innovations, business expansions there are a lot of things to worry about in the software design methodologies. Currently IT industry is witnessing major changes in the processor architecture such as multicore processor technology [5], and the demand for high performance. Today we have more computing power with affordable price. But the question arises is: Are we ready to exploit this power? We have a number of processors starting from dual core to several number of cores, how do we effectively utilize those? We have more CPUs than number of I/O channels, how can we deal with an application that needs to utilize CPU and I/O? In this paper we are going to demonstrate with limited number of I/O channel how effectively we can split a large file with high speed.