Gpu Shuffling

[AaditSaluja]

No description provided.

[AaditSaluja]

Adds 2 new shufflinf methods

• gpu_iobatch/ gpu: Emulates the existing shuffling algorithm just pushing the process of shuffling within an io_batch_size to the GPU. Slightly faster in some scenarios, specially for heavy compute models. Further, with recent trends in hardware, should scale better than cpu shuffling in the future. Bottlenecked by size of gpu memory.

• gpu_minibatch: Skips the selection of random shuffle_chunk_size sized chunks that are the level 1 of shufflinf algorithm, only shuffling within each mini batch for a more localized version of shuffling. It benefits from runtimes that are within ~4-5% of just not shuffling at all.

I will be adding some tests for these to the testing infrastructure soon

[AaditSaluja]

With no GPU on the CI runner, gpu shufflinf tests are skipped. Did run them locally and they pass reliably! The branch should be ready to merge