Can you use
Memory Mapped Files[
^] (.Net 4)?
Without knowing more about your problem it is impossible to answer. Direct indexed access to a byte array in memory should be fast enough, I strongly suspect (particularly given your inability to provide a working for loop in your sample) that any speed problems you are having are elsewhere in your code.