Salt: repo.saltstack.com should support RSYNC

[ianare]

Our internal servers have (rightly) no Internet access. We've been mirroring the EPEL repo but would like to use the official packages instead.

Could you enable RSYNC on repo.saltstack.com? Otherwise we will do via HTTP which will waste everyone's bandwidth :-(

rsync -avz repo.saltstack.com::yum/rhel7/ test
rsync: failed to connect to repo.saltstack.com (198.199.77.106): Connection refused (111)
rsync error: error in socket IO (code 10) at clientserver.c(128) [Receiver=3.1.0]

Thank you!

[justinta]

@ianare I think @UtahDave would be the best to answer this question. Thanks!

[edgan]

+1

[oznah]

+1

[jremond]

+1 it would be much appreciated if available

[titilambert]

+1 :)

[windoverwater]

+1 :)

[c4t3l]

+1

[Jerry-Fix]

+1

[scoobydooxp]

+1

rsync support would be huge. reposync keeps puking all over the place trying to mirror things. I'm sure the Salt team prefers we have local mirrors instead of having 10's if not 100's of thousands of hosts update direct.

[FerrySchuller]

+1

[lorengordon]

+1

[damon-atkins]

+1

[rickh563]

ZD-780

[curiositycasualty]

+1

[rmrf]

+1

[danny-smit]

+1 for enabling rsync support

Any insights available whether this is going to make it anytime soon or that it will be someday in the (far) future? (being an outsider, I'm not sure what to think of milestone "C 8", as its due date is almost there, but there is also a lot still to do for that milestone as it seems)

[curiositycasualty]

As a workaround: we currently use wget -m to mirror the salt repo(s).

[arthtux]

:+1:

[UtahDave]

OK, thank you for your patience, everyone. We now have rsync available at rsync.repo.saltstack.com. This rsync matches the contents of repo.saltstack.com exactly.

You can list the available modules like this:

[boucha@elsapo test]$ rsync rsync://rsync.repo.saltstack.com

saltstack_pkgrepo_full  Contents of repo.saltstack.com
saltstack_pkgrepo_debian    SaltStack Debian repo
saltstack_pkgrepo_ubuntu    SaltStack Ubuntu repo
saltstack_pkgrepo_rhel  SaltStack RHEL repo
saltstack_pkgrepo_freebsd   SaltStack FreeBSD repo
saltstack_pkgrepo_opensuse  SaltStack OpenSUSE repo
saltstack_pkgrepo_windows   SaltStack Windows repo
saltstack_pkgrepo_osx   SaltStack OS X repo

The saltstack_pkgrepo_full module will give you an exact copy of the entire contents at repo.saltstack.com.
The other modules such as saltstack_pkgrepo_ubuntu provide just the subsection of the repo indicated in the name.

To get a clone of the entire repo.saltstack.com in a directory named fullrepo in your current working directory you can run the following command:

rsync -vaH --numeric-ids --delete --delete-after --delay-updates rsync://rsync.repo.saltstack.com/saltstack_pkgrepo_full ./fullrepo

I've posted this information here in the hopes that we could get some feedback and testing before making a public announcement.

Thanks so much!

[UtahDave]

Question for this group:

Would it be preferable to have repo.saltstack.com provide rsync rather than the longer rsync.repo.saltstack.com?

[UtahDave]

OK, please use repo.saltstack.com directly for rsync.

[boucha@elsapo tmp]$ rsync rsync://repo.saltstack.com
saltstack_pkgrepo_full  Contents of repo.saltstack.com
saltstack_pkgrepo_debian    SaltStack Debian repo
saltstack_pkgrepo_ubuntu    SaltStack Ubuntu repo
saltstack_pkgrepo_rhel  SaltStack RHEL repo
saltstack_pkgrepo_freebsd   SaltStack FreeBSD repo
saltstack_pkgrepo_opensuse  SaltStack OpenSUSE repo
saltstack_pkgrepo_windows   SaltStack Windows repo
saltstack_pkgrepo_osx   SaltStack OS X repo

rsync -vaH --numeric-ids --delete --delete-after --delay-updates rsync://repo.saltstack.com/saltstack_pkgrepo_full ./fullrepo

I'm going to leave rsync.repo.saltstack.com up for a while, but please consider it deprecated.

[lorengordon]

Thanks @UtahDave!

[c4t3l]

YEAHH!!!! Thanks Utah Dave!!!!

On Wed, Jul 20, 2016 at 12:29 PM, David Boucha [email protected]
wrote:

OK, please use repo.saltstack.com directly for rsync.

[boucha@elsapo tmp]$ rsync rsync://repo.saltstack.com
saltstack_pkgrepo_full Contents of repo.saltstack.com
saltstack_pkgrepo_debian SaltStack Debian repo
saltstack_pkgrepo_ubuntu SaltStack Ubuntu repo
saltstack_pkgrepo_rhel SaltStack RHEL repo
saltstack_pkgrepo_freebsd SaltStack FreeBSD repo
saltstack_pkgrepo_opensuse SaltStack OpenSUSE repo
saltstack_pkgrepo_windows SaltStack Windows repo
saltstack_pkgrepo_osx SaltStack OS X repo

I'm going to leave rsync.repo.saltstack.com up for a while, but please
consider it deprecated.

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/saltstack/salt/issues/29222#issuecomment-234020952,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AHh4w0K1fdT7ScdAlibk5qBtkZjH9_Xmks5qXlsKgaJpZM4Gp5fg
.

[Jock-TNT]

good!Thanks Utah Dave!!

[haam3r]

Might there also be a rsync repo for the new Python3 packages i.e. something like:
rsync://repo.saltstack.com/py3/saltstack_pkgrepo_ubuntu?

[suykerbuyk]

I believe the definition of rsync://repo.saltstack.com/saltstack_pkgrepo_full is missing
the latest RHEL release: https://repo.saltstack.com/yum/redhat/7/x86_64/2018.3/

[dmurphy18]

@UtahDave Can you check out this rsync issue ?

[lapfrank12]

Was rsync disabled? I can't seem to use rsync://repo.saltstack.com anymore, the rsync port is not responding.