Commit Graph

643 Commits (master)

Author SHA1 Message Date
Adam D. Barratt 653357779c d/changelog: whitespace fix 2023-10-20 16:42:35 +01:00
Adam D. Barratt 0a4e6c4e2c Add changelog entries for "recent" changes 2023-10-20 16:40:44 +01:00
Adam D. Barratt 2bf7578e16 Fix support for multiple custom host SSH options
The process of passing host options from runmirrors to SSH triggers
protects multi-word options by converting spaces to hashes, and then
back again. However, it only performs a single replacement in each
case, meaning that "-p 1234" works, but "-p 1234 -4" is treated as
equivalent to "-p 1234" (and "-4 -p 1234" to "-4 -p")
2023-09-09 12:32:38 +01:00
Julien Cristau 183eb7f89f ci: add bookworm test environment 2023-08-09 16:13:19 +02:00
Raphaël Hertzog 3832831788
Ensure that hook commands with parameters are supported
With this change and without the fix, we get failures:
$ bats scripts/default/ftpsync.bats
 ✗ run ftpsync
   (in test file scripts/default/ftpsync.bats, line 7)
     `[[ $status -eq 0 ]]' failed
 ✗ run ftpsync, ssh command
   (in test file scripts/default/ftpsync.bats, line 21)
     `[[ $status -eq 0 ]]' failed
 ✓ run ftpsync with non-existant archive
 ✓ run ftpsync with non-existant archive, ssh comman
 ✗ run ftpsync with non-default trigger
   (in test file scripts/default/ftpsync.bats, line 45)
     `[[ $status -eq 0 ]]' failed

With the fix, it works as expected:
$ bats scripts/default/ftpsync.bats
 ✓ run ftpsync
 ✓ run ftpsync, ssh command
 ✓ run ftpsync with non-existant archive
 ✓ run ftpsync with non-existant archive, ssh comman
 ✓ run ftpsync with non-default trigger

5 tests, 0 failures
2022-04-01 14:27:11 +02:00
Julien Cristau 9ae66128e3 ci: add bullseye and sid test environments 2022-04-01 11:14:13 +00:00
Niklas Edmundsson aea1d338c1 Add quoting to boundary parameter in MIME header
Fix quoting boundary in MIME header so mail sent is compliant instead of
displayed as malformed by strict mail readers.

Signed-off-by: Raphaël Hertzog <hertzog@debian.org>
2022-04-01 10:54:11 +00:00
Raphaël Hertzog 0845babb1b Properly quote HOOKSCR assignments
Otherwise ftpsync is failing with bash 5.1 with errors like this:
ftpsync: line 276: local: `hook-parameter': not a valid identifier

Closes: #1008773
2022-04-01 10:53:30 +00:00
Raphaël Hertzog 585bd5f4e8
Update installer-$arch/current in stage 2
There are scripts fetching the current installer images through
the dists/$release/main/installer-$arch/current/images/ path
and they are validating the MD5SUMS and SHA256SUMS in this
directory against the Release file. So let's update the symlink
in stage 2 as well so that we ensure that everything is in sync
at this point.
2021-07-16 12:16:15 +02:00
Raphaël Hertzog c7b3249fef
Exclude dep11/* files from stage 1
They are listed in the Release/InRelease files and must be updated in
sync with those files.

We also change --include=i18n/by-hash into an earlier --include=by-hash/
to cover all by-hash directories no matter where they are located
because dep11/by-hash/ is a thing too.

Closes: #991166
2021-07-16 12:11:19 +02:00
Raphaël Hertzog 1d1fb755f6
Exclude Contents* files from stage 1
They are listed in the Release/InRelease files and must be updated in
sync with those files.
2021-07-16 12:04:06 +02:00
Peter Palfrader 6abc9e0361 fix ftpsync-cron crontab 2021-06-22 21:12:52 +02:00
Debian Janitor 701076f714 Update standards version to 4.1.5, no changes needed.
Fixes: lintian: out-of-date-standards-version
See-also: https://lintian.debian.org/tags/out-of-date-standards-version.html
2021-04-25 21:31:26 +00:00
Debian Janitor 7da0a287c5 Set debhelper-compat version in Build-Depends.
Fixes: lintian: uses-debhelper-compat-file
See-also: https://lintian.debian.org/tags/uses-debhelper-compat-file.html
2021-04-25 21:31:26 +00:00
Debian Janitor f5040586a4 Bump debhelper from old 10 to 12.
Fixes: lintian: package-uses-old-debhelper-compat-version
See-also: https://lintian.debian.org/tags/package-uses-old-debhelper-compat-version.html
2021-04-25 21:31:26 +00:00
Joerg Jaspert 6b5cf35099 remove centos6, make debian use buster not stretch 2021-04-25 23:24:54 +02:00
Joerg Jaspert f952fda2f1 Take out "safeguards", let it break things. 2021-04-25 23:14:33 +02:00
Joerg Jaspert 9d1b482b77 Allow to chose which sections to archive
Possibly not used often, but easy to offer, default to debmirrors
default.
2021-04-25 23:13:53 +02:00
Joerg Jaspert 9fd91827d0 Use debmirrors --user parameter 2021-04-25 15:49:11 +02:00
Joerg Jaspert e19ca7e5be Adjust way to find user/passwort
- for main archive, we go locally and get us a random secret from the
rsyncd config
- for security archive, there is a mirror config rolled out (which
never gets pushed), use that data
2021-04-25 15:21:01 +02:00
Joerg Jaspert 2be62eadab Make shellcheck happy 2021-04-25 15:20:52 +02:00
Joerg Jaspert fa925c34c6 Comments are good 2021-04-25 13:40:13 +02:00
Joerg Jaspert 434f79dffa Variable for the rsync secrets file 2021-04-25 13:39:37 +02:00
Joerg Jaspert 7ac9678bd1 archive a release to archive.d.o 2021-04-25 13:31:16 +02:00
Bastian Blank 57af581ff2 Update Vcs entries to reality 2018-05-13 15:08:38 +02:00
Bastian Blank 78945d8244 Release 20180513 2018-05-13 12:43:56 +02:00
Bastian Blank 82550f906f Report time for both stages in staged pushs in trace 2018-05-08 16:41:23 +02:00
Bastian Blank a6f569d0e0 Specify stage1 trace file name only once 2018-05-08 16:41:23 +02:00
Bastian Blank f7c1f5f5f3 Factor out generic trace parsing functions 2018-05-08 16:41:23 +02:00
Bastian Blank fbeb0e3319 Lower rsync timeout to 120 seconds
We increasingly see TCP connections with insanely low timeouts.
Especially in NAT or proxy environments, these timeouts can be as low as
two or four minutes.  This makes them even too low for the default
interval of the TCP keepalives enabled with SO_KEEPALIVE.

The IO timeout setting in rsync also enables sending protocol level
keepalives every half timeout.  Apart from a higher rate of keepalives,
this change should not incur any cost.

Closes: #882381
2018-05-06 18:57:45 +02:00
Bastian Blank ce51ef804b Update Standards-Version to 4.1.4, no changes 2018-05-06 12:38:00 +02:00
Bastian Blank bf868ed5a1 Make tar generation reproducible
To generate the tar file reproducible we ask tar to sort the name, set
the mtime to the build date and set root as owner and group for all
files.

Closes: #856860
2018-05-06 12:31:05 +02:00
Bastian Blank c2b37c42ad Disable incremental recursive mode
Incremental recursive mode causes rsync to receive file entries one by
one, causing long run times just to retrieve the file list.  Without it,
rsync just retrieves the file list in one transfer.
2018-05-06 10:08:29 +02:00
Bastian Blank d5b8fa10b8 List full sync flags 2018-03-03 08:48:30 +01:00
Bastian Blank f873e07087 Fix formatting of documentation 2018-03-03 08:45:39 +01:00
Bastian Blank 824c95ad77 Drop tests against security.debian.org
We can't access rsync on security.debian.org on the runners provided by
salsa.debian.org.
2018-02-16 19:21:39 +01:00
Bastian Blank d8bdb1f24e Don't try to re-assign stdin 2017-12-24 16:02:55 +01:00
Bastian Blank 6214e19810 Ignore errors from grep over missing mirrors file 2017-12-24 14:21:48 +01:00
Bastian Blank bf56922444 Never try to write to log file explicitely 2017-12-24 12:29:33 +01:00
Bastian Blank 369b2ddf52 Always open log file and assign file descriptor 2017-12-24 12:29:33 +01:00
Bastian Blank 72ab6fa31b Handle log messages to per-mirror runmirrors log 2017-12-23 20:19:38 +01:00
Bastian Blank dcb821a9c0 Factor out log message assemble 2017-12-23 20:19:38 +01:00
Bastian Blank f664a386c4 Factor out names of rsync log and error file 2017-12-23 18:57:58 +01:00
Bastian Blank 396093fd58 Fix log file parser to cope with timestamps 2017-12-23 18:34:24 +01:00
Bastian Blank fcb397354f Ask rsync to write the log file for us
The log file output of rsync always include timestamps.
2017-12-23 18:11:44 +01:00
Bastian Blank 902cd3d3fa Break siblings out of push lock wait if timeout hits
If one lock wait timeouts, it delets it's own lock file.  This makes it
impossible for the siblings to ever find all files existing at the same
time.  Make sure they break out the wait loop in this case by always
creating the all done marker.
2017-12-15 17:11:08 +01:00
Bastian Blank b407055fe6 Move info about ftpsync options into man page 2017-11-25 18:32:01 +01:00
Bastian Blank 98d7429d2d Fix directory handling in tests 2017-11-25 18:31:02 +01:00
Bastian Blank 6975620f36 Convert security tests to use bats and new structure 2017-11-25 18:30:50 +01:00
Bastian Blank 21e689a12e Move simple tests to combined test structure
Having a common tests tree makes unifying tests easier.
2017-11-25 18:29:54 +01:00