Synchronization Solution on Windows (RSYNC)

img from unsplash

These are the basic steps to set up and use an rsync tool for synchronization on Windows.

Setup RSYNC Server on Windows

i. Manual Setup

1. Install RSYNC on the server machines.
   Install Rsync software like a linux through Chocolatey

choco install rsync -y

1. On the server, create a folder to share

mkdir -p C:\rsync_share

e.g. C:\rsync_share. as rsync share folder.

1. On the server,Create the C:\rsync\rsyncd.conf file with the following contents:

[rsync_share] 
path = /cygdrive/c/rsync_share
use chroot = no
ignore errors  
read only = no
list = yes

This configures the share name as "rsync_share" pointing to the C:\rsync_share folder.

Use cygdrive path prefix as /cygdrive/c/rsync_share

1. On the server, open PowerShell and run the rsync daemon:

rsync --daemon --config=C:\rsync\rsyncd.conf

This will run the rsync daemon using the config file C:\rsync\rsyncd.conf.

1. You may need to configure firewall rules on the server to allow incoming TCP connections to port 873

(The rsync daemon default port).

1. Rsync service is set to run automatically on startup on the server via "Task Scheduler".

ii. Automatic via Script

Here are Windows scripts to automatically install rsync, configure it, and open the firewall port:

1. Update Policy to allow execute self PowerShell script.

Set-ExecutionPolicy RemoteSigned

Execution Policy Change
The execution policy helps protect you from scripts that you do not trust. Changing the execution policy might expose
you to the security risks described in the about_Execution_Policies help topic at
https:/go.microsoft.com/fwlink/?LinkID=135170. Do you want to change the execution policy?
[Y] Yes [A] Yes to All [N] No [L] No to All [S] Suspend [?] Help (default is "N"): y

1. Create Windows PowerShell Script

Save all below content to a PowerShell script as names "rsync-config.ps1"

# Create rsync config and share folders
New-Item -Path C:\rsync -ItemType Directory
New-Item -Path C:\rsync_share -ItemType Directory

# Create rsync.conf file
@"
[rsync_share]
path = /cygdrive/c/rsync_share
ignore errors
read only = no
list = yes
auth users = rsync
secrets file = /cygdrive/c/rsync/rsync.passwd
"@ | Add-Content -Path C:\rsync\rsyncd.conf

# Open port 873 for rsync
New-NetFirewallRule `
    -Name "Rsync Daemon (873)" `
    -DisplayName "Rsync Daemon (873)" `
    -Protocol TCP `
    -LocalPort 873

# Create scheduled task to run rsync daemon
$Trigger = New-ScheduledTaskTrigger -AtStartup
$Action = New-ScheduledTaskAction `
    -Execute "Powershell.exe" `
    -Argument "rsync --daemon --config=C:\rsync\rsyncd.conf"
Register-ScheduledTask `
    -TaskName "Rsync Daemon" `
    -Trigger $Trigger `
    -Action $Action `
    -RunLevel Highest `
    -User System

The format of the rsync password file(C:rsyncrsync.passwd) is as follows:

username:password

• username: This is the username for the rsync account.
• password: This is the password for the rsync account.

Each line in the file represents a single rsync account. Create multiple accounts by adding additional lines to the file.

1. Execute the PowerShell Script

run on Windows server to automatically setup rsync daemon, create share folder names "rsync_share" and configure the firewall. moreover, the rsync service startup on reboot.

Setup RSYNC Client on Windows

Install RSYNC on the client machines.
Install Rsync software like a linux through Chocolatey

choco install rsync -y

Operating

i. Manual

On the client PC, create a folder to store rsync data

mkdir -p C:\rsync_client

Directory: C:\

Mode LastWriteTime Length Name

---- ------------- ------ ----

d----- 7/11/2023 12:46 PM rsync_client

For example:

To sync files from client to server (PUSH):

rsync -avz /cygdrive/c/rsync_client  rsync://server_ip_address/rsync_share

To sync files from server to client (PULL):

rsync -avz rsync://server_ip_address/rsync_share /cygdrive/c/rsync_client 

To sync files from server to client with --progress flag on Linux

rsync -avz --progress --update --chmod=ugo=rwX --delete rsync://server_ip_address/rsync_share ./rsync_client

i. Automatic via Script

Update Policy to allow execute self PowerShell script.

Set-ExecutionPolicy RemoteSigned

1. Create Windows PowerShell Script

Save all below content to a PowerShell script as names "rsync-client.ps1"

# Set variables
$RsyncPullFolder = "C:\rsync_pull"
$RsyncConfigFolder = "C:\rsync"
$Source = "/cygdrive/c/rsync_pull"
$Destination = "rsync_server_ip::share"
$Username = "rsync"
$Password = "P@ssw0rd123!"
$TaskName = "Rsync Pull"
$TriggerTime = "08:00"


# Check if rsync_pull and rsync folders exist, and create them if they don't
if (!(Test-Path $RsyncPullFolder)) {
    New-Item -ItemType Directory -Path $RsyncPullFolder
}
if (!(Test-Path $RsyncConfigFolder)) {
    New-Item -ItemType Directory -Path $RsyncConfigFolder
}
New-Item -Path "$RsyncConfigFolder" -Name "rsync.passwd" -ItemType "File"
Add-Content -Path "$RsyncConfigFolder\rsync.passwd" -Value "$Password"


# Build rsync command
$RsyncCommand = "rsync -avz --progress --update --chmod=ugo=rwX --delete --password-file=/cygdrive/c/rsync/rsync.passwd $Username@$Destination $Source"

# Create scheduled task to run rsync command
$Trigger = New-ScheduledTaskTrigger -Daily -At $TriggerTime
$Action = New-ScheduledTaskAction -Execute "Powershell.exe" -Argument "$RsyncCommand"
Register-ScheduledTask -TaskName $TaskName -Trigger $Trigger -Action $Action -RunLevel Highest -User "SYSTEM"

This script runs on a Windows client and automatically sets up an rsync schedule, creates an rsync folder named 'rsync_pull', and configures the username and password for authorization.

Conclusion

rsync can be a reliable and efficient solution for file synchronization on Windows, with its ability to preserve file attributes, compress data during transfer, and show verbose output.

To use rsync on Windows, you can install a version of rsync compatible with Windows, configure your system's firewall and network settings, and create a configuration file to specify the files and directories to be synced.

Reference

• How-to Run a PowerShell Script
• The cygdrive path prefix

Related

• RSYNC USAGE