RCP TOOLS

This repo contains tools to efficiently copy, remove and link large filesets, both locally and across remote hosts.

Website · Performance reports · Installation

• rcp is for copying files; similar to cp but generally MUCH faster when dealing with large filesets.

  Supports both local and remote copying using host:/path syntax (similar to scp).

  Inspired by tools like dsync(1) and pcp(2).

• rrm is for removing large filesets.

• rchm is for recursively changing permissions and ownership of large filesets; a fast replacement for dchmod(3).

• rlink allows hard-linking filesets with optional update path; typically used for hard-linking datasets with a delta.

• rcmp tool is for comparing filesets.

• filegen tool generates sample filesets, useful for testing.

Benchmarks

The performance report compares rcp with dcp, GNU cp, and rsync across Lustre, Weka, NFS, XFS, and ZFS, remote transfers, and a Linux source tree. It includes default settings, concurrency sweeps, SVG figures, and the complete…