Rclone for piqlConnect
Article describing how to use Rclone for transfer of data to piqlConnect
What is Rclone?
Rclone is a robust, mature command-line program to manage files across a wide range of cloud storage services. It supports over 90 backends and is especially known for its speed, flexibility, and extensive automation capabilities. Rclone allows encrypted, synchronized, and high-performance transfers—making it a natural fit for enterprise-grade solutions like piqlConnect.
piqlConnect now supports integration with Rclone, a powerful open-source command-line tool for managing files on cloud storage. With this implementation, users can seamlessly transfer data from leading cloud platforms directly into piqlConnect, streamlining workflows for digital preservation and secure archiving.
- Backup (and encrypt) files to cloud storage
- Restore (and decrypt) files from cloud storage
- Mirror cloud data to other cloud services or locally
- Migrate data to the cloud, or between cloud storage vendors
- Mount multiple, encrypted, cached or diverse cloud storage as a disk
- Transfers
- MD5, SHA1 hashes are checked at all times for file integrity
- Timestamps are preserved on files
- Operations can be restarted at any time
- Can be to and from network, e.g. two different cloud providers
- Can use multi-threaded downloads to local disk
- Copy new or changed files to cloud storage
- Sync (one way) to make a directory identical and Bisync (two way) to keep two directories in sync bidirectionally
- Check hashes and for missing/extra files
Supported Cloud Platforms
With Rclone integration, piqlConnect now enables direct data ingestion from among others some of the biggest storage platforms:
- Dropbox
- Google Drive
- Apple iCloud
- Box
- Microsoft OneDrive
- Microsoft Azure Blob Storage
- Amazon S3
This broad compatibility eliminates the need for manual downloads or custom scripts—users can transfer content directly from their preferred cloud service into piqlConnect’s secure environment.
Key Benefits
- Streamlined Data Ingestion: Move files from popular platforms directly into piqlConnect with just a few commands.
- Automation Ready: Easily script and schedule transfers for automated archiving and backup.
- High Performance: Rclone is optimized for large-scale data migration and handles high-volume files efficiently.
- Security and Integrity: Supports checksums, encryption, and bandwidth throttling to ensure safe, controlled transfers.
Getting Started
To implement Rclone with piqlConnect, get in touch with us at support@piql.com and we will help you get going.
Summary
Rclone brings an extra layer of flexibility and compatibility to piqlConnect, allowing users to bridge cloud services with secure digital preservation—without changing their existing workflows. Whether you're centralizing data from multiple departments, archiving historical documents, or ensuring long-term data integrity, Rclone empowers you to do it quickly and securely.