Improve ArchiveReader performance

GPFS has a poor random access I/O performance with small data size. ArchiveReader needs to be optimized to increase throughput.

  • Reduce the number of syscalls by disabling default buffer or increasing buffer size.
  • Provide configuration to customise buffer size.
  • Avoid small size read.
  • Implement asyncio version.
Edited Mar 22, 2022 by Theodore Chang
Assignee Loading
Time tracking Loading