Allow to run daily backups without automatic updates

[marcatsmci]

Steps to reproduce

1. Activate Daily Backup

Expected behavior

1. Backup ok
2. Nextcloud stay in actual version : no auto update !

Actual behavior

1. Backup ok
2. If a new version of NC is available, the new version is installed

Host OS

Debian 11

Nextcloud AIO version

Latest - 1.2.1

Current channel

Stable

Other valuable info

The upgrade to another Nextcloud version must absolutely remain a decision of the system engineer. This cannot be done automatically.

[szaimen]

This is a feature request.

[szaimen]

That daily backups auto-updates all things is btw documented.

[szaimen]

So then is something wrong here... What does the backup log say?

[Waldorf3]

This is the log:

initializing repository...
using builtin fallback logging configuration
35 self tests completed in 0.13 seconds
Initializing repository at "/mnt/borgbackup/borg"
Key in "<Repository /mnt/borgbackup/borg>" created.
Keep this key safe. Your data will be inaccessible without it.
check_free_space: few segments, not requiring a full free segment
check_free_space: calculated working space for compact as 0 bytes
check_free_space: required bytes 169138, free bytes 17405681664
security: previous location file /root/.config/borg/security/c65741d2ec9ec1dc0a79dcc22142bfb662a9191100cef0698f0c94ee35c01a41/location not found
security: manifest timestamp file /root/.config/borg/security/c65741d2ec9ec1dc0a79dcc22142bfb662a9191100cef0698f0c94ee35c01a41/manifest-timestamp not found
security: determined newest manifest timestamp as 
security: remembering previously unknown repository
security: saving state for c65741d2ec9ec1dc0a79dcc22142bfb662a9191100cef0698f0c94ee35c01a41 to /root/.config/borg/security/c65741d2ec9ec1dc0a79dcc22142bfb662a9191100cef0698f0c94ee35c01a41
security: current location   /mnt/borgbackup/borg
security: key type           5
security: manifest timestamp 2022-05-24T09:50:13.596982
security: repository checks ok, allowing access
Synchronizing chunks cache...
Archives: 0, w/ cached Idx: 0, w/ outdated Idx: 0, w/o cached Idx: 0.
Verified integrity of /mnt/borgbackup/borg/index.1
Done.
security: saving state for c65741d2ec9ec1dc0a79dcc22142bfb662a9191100cef0698f0c94ee35c01a41 to /root/.config/borg/security/c65741d2ec9ec1dc0a79dcc22142bfb662a9191100cef0698f0c94ee35c01a41
security: current location   /mnt/borgbackup/borg
security: key type           5
security: manifest timestamp 2022-05-24T09:50:13.596982

By default repositories initialized with this version will produce security
errors if written to with an older version (up to and including Borg 1.0.8).

If you want to use these older versions, you can disable the check by running:
borg upgrade --disable-tam /mnt/borgbackup/borg

See https://borgbackup.readthedocs.io/en/stable/changes.html#pre-1-0-9-manifest-spoofing-vulnerability for details about the security implications.

IMPORTANT: you will need both KEY AND PASSPHRASE to access this repo!
Use "borg key export" to export the key, optionally in printable format.
Write down the passphrase. Store both at safe place(s).

Repository successfully initialized.
Performing backup...
Starting the backup...
0 B O 0 B C 0 B D 0 N nextcloud_aio_volumes                                     
zing cache transaction: Reading config
zing cache transaction: Reading chunks
zing cache transaction: Reading files
B O 174.85 kB C 174.85 kB D 234 N nextcloud_aio_vo...iderInterfaceV2.php
O 299.18 kB C 299.18 kB D 446 N nextcloud_aio_vol...exModelsV2/Exception
O 457.35 kB C 457.35 kB D 638 N nextcloud_aio_vol...utpostsException.php
O 810.95 kB C 810.95 kB D 848 N nextcloud_aio_vol...aginators-1.json.php
 O 1.41 MB C 1.41 MB D 1030 N nextcloud_aio_volu...13/waiters-2.json.php
 O 1.93 MB C 1.93 MB D 1215 N nextcloud_aio_volu...-11-20/api-2.json.php
 O 2.43 MB C 2.43 MB D 1376 N nextcloud_aio_volu...-07-24/api-2.json.php
 O 2.93 MB C 2.93 MB D 1591 N nextcloud_aio_volu...e-versions-deprecated
 O 3.35 MB C 3.35 MB D 1837 N nextcloud_aio_volu...SchemaDiffVisitor.php
 O 3.62 MB C 3.62 MB D 2149 N nextcloud_aio_volu...rrier/data/en/266.php
 O 3.96 MB C 3.96 MB D 2509 N nextcloud_aio_volu...NumberMetadata_MK.php
 O 4.48 MB C 4.48 MB D 2873 N nextcloud_aio_volu...coding/data/en/20.php
 O 5.70 MB C 5.70 MB D 3037 N nextcloud_aio_volu...oding/data/en/880.php
 O 6.60 MB C 6.60 MB D 3201 N nextcloud_aio_volu...ey/locale/data/af.php
 O 7.19 MB C 7.11 MB D 3557 N nextcloud_aio_volu...ey/locale/data/yo.php
 O 7.50 MB C 7.42 MB D 3798 N nextcloud_aio_volu...i/src/HttpFactory.php
 O 7.83 MB C 7.75 MB D 4063 N nextcloud_aio_volu...ullsafeMethodCall.php
 O 8.10 MB C 8.02 MB D 4276 N nextcloud_aio_volu...ttp/httplug/puli.json
 O 8.55 MB C 8.47 MB D 4491 N nextcloud_aio_volu...iFactoryInterface.php
 O 9.20 MB C 9.05 MB D 4755 N nextcloud_aio_volu...de/data/hu/units.json
 O 9.82 MB C 9.66 MB D 4984 N nextcloud_aio_volu...data/vi/calendar.json
 O 10.25 MB C 10.09 MB D 5256 N nextcloud_aio_vol...rObjectContainer.php
 O 10.69 MB C 10.54 MB D 5495 N nextcloud_aio_vol...y/ICalendar/Date.php
 O 11.11 MB C 10.95 MB D 5769 N nextcloud_aio_vol...ners/SMimeSigner.php
 O 11.76 MB C 11.60 MB D 6020 N nextcloud_aio_vol...-iconv/bootstrap.php
 O 12.14 MB C 11.98 MB D 6274 N nextcloud_aio_vol...e/deprecated/apc.php
 O 12.90 MB C 12.73 MB D 6614 N nextcloud_aio_vol...nt-opendyslexic2.jpg
 O 14.32 MB C 14.15 MB D 6804 N nextcloud_aio_vol...ity-dashboard.js.map
 O 16.01 MB C 15.82 MB D 6988 N nextcloud_aio_vol...ity/l10n/[email protected]
 O 16.66 MB C 16.39 MB D 7323 N nextcloud_aio_vol...circles/l10n/nl.json
 O 17.21 MB C 16.94 MB D 7667 N nextcloud_aio_vol...lib/Model/Circle.php
 O 18.41 MB C 18.05 MB D 7927 N nextcloud_aio_vol.../comments-app.js.map
 O 19.35 MB C 18.96 MB D 8194 N nextcloud_aio_vol...raction/l10n/es.json
 O 31.51 MB C 31.12 MB D 8284 N nextcloud_aio_vol...-tapioca-bubbles.jpg
B O 35.57 MB C 35.17 MB D 8402 N nextcloud_aio_vo...-availability.js.map
B O 36.25 MB C 35.81 MB D 8719 N nextcloud_aio_vo.../Db/DirectMapper.php
B O 36.86 MB C 36.35 MB D 9042 N nextcloud_aio_vo...MissingException.php
B O 37.33 MB C 36.75 MB D 9394 N nextcloud_aio_vo...ederation/l10n/pl.js
B O 38.83 MB C 38.25 MB D 9487 N nextcloud_aio_vo...onal-settings.js.map
B O 40.50 MB C 39.85 MB D 9692 N nextcloud_aio_vo...pps/files/l10n/ml.js
B O 41.04 MB C 40.37 MB D 9990 N nextcloud_aio_vo..._external/l10n/ca.js
B O 42.08 MB C 41.35 MB D 10300 N nextcloud_aio_vo...js/build/pdf.js.map
B O 44.08 MB C 43.35 MB D 10376 N nextcloud_aio_vo...eb/cmaps/GB-V.bcmap
B O 46.01 MB C 45.28 MB D 10650 N nextcloud_aio_vo...tionSans-Italic.ttf
B O 47.98 MB C 47.22 MB D 10898 N nextcloud_aio_vo...st/files_sharing.js
B O 49.94 MB C 49.18 MB D 10921 N nextcloud_aio_vo..._sharing/l10n/az.js
B O 50.77 MB C 49.98 MB D 11215 N nextcloud_aio_vo...mposer/autoload.php
B O 51.15 MB C 50.33 MB D 11485 N nextcloud_aio_vo...les_versions.js.map
B O 52.25 MB C 51.43 MB D 11720 N nextcloud_aio_vo..._video_es_js.js.map
B O 55.36 MB C 54.51 MB D 11925 N nextcloud_aio_vo...ard/l10n/zh_CN.json
B O 56.09 MB C 55.22 MB D 12214 N nextcloud_aio_vo...onnector/l10n/el.js
B O 57.00 MB C 56.10 MB D 12461 N nextcloud_aio_vo...cations-main.js.map
B O 58.21 MB C 57.30 MB D 12643 N nextcloud_aio_vo...ications/l10n/uk.js
B O 59.15 MB C 58.21 MB D 12858 N nextcloud_aio_vo...icy-settings.js.map
B O 60.20 MB C 59.25 MB D 13083 N nextcloud_aio_vo...y/lists/list-39.php
B O 63.28 MB C 62.33 MB D 13087 N nextcloud_aio_vo...cy/lists/list-8.php
B O 65.61 MB C 64.64 MB D 13129 N nextcloud_aio_vo...d_vue-701342.js.map
B O 67.82 MB C 66.84 MB D 13341 N nextcloud_aio_vo.../js/privacy-main.js
B O 69.24 MB C 68.23 MB D 13539 N nextcloud_aio_vo...ons/js/dashboard.js
B O 70.43 MB C 69.41 MB D 13720 N nextcloud_aio_vo...nfo/l10n/es_HN.json
B O 72.53 MB C 71.48 MB D 13918 N nextcloud_aio_vo...n-delegation.js.map
B O 75.09 MB C 74.04 MB D 13928 N nextcloud_aio_vo...ersonal-info.js.map
B O 77.43 MB C 76.38 MB D 13935 N nextcloud_aio_vo...s-settings-users.js
B O 79.63 MB C 78.41 MB D 14026 N nextcloud_aio_vo...ttings/l10n/hu.json
B O 80.64 MB C 79.38 MB D 14266 N nextcloud_aio_vo...rebymail/l10n/hu.js
B O 81.37 MB C 80.08 MB D 14566 N nextcloud_aio_vo.../Categories/Php.php
B O 83.33 MB C 81.98 MB D 14881 N nextcloud_aio_vo...light/axapta.js.map
B O 83.94 MB C 82.60 MB D 15118 N nextcloud_aio_vo...light/prolog.js.map
B O 85.81 MB C 84.46 MB D 15252 N nextcloud_aio_vo.../text/js/vendors.js
B O 87.35 MB C 85.99 MB D 15457 N nextcloud_aio_vo...s/text/CHANGELOG.md
B O 88.17 MB C 86.75 MB D 15721 N nextcloud_aio_vo...pcodes/l10n/ja.json
B O 89.08 MB C 87.45 MB D 16001 N nextcloud_aio_vo...ser_ldap/l10n/ko.js
B O 90.01 MB C 88.37 MB D 16221 N nextcloud_aio_vo...tus/js/dashboard.js
B O 92.25 MB C 90.62 MB D 16237 N nextcloud_aio_vo...status/l10n/cs.json
B O 93.61 MB C 91.98 MB D 16354 N nextcloud_aio_vo...s/viewer/l10n/af.js
B O 94.13 MB C 92.49 MB D 16582 N nextcloud_aio_vo...s/weather-status.js
B O 96.44 MB C 94.79 MB D 16679 N nextcloud_aio_vo...rkflowengine.js.map
B O 96.95 MB C 95.28 MB D 16991 N nextcloud_aio_vo...tsNewController.php
B O 103.58 MB C 101.90 MB D 17162 N nextcloud_aio_v...3-running-step.png
B O 107.91 MB C 106.23 MB D 17343 N nextcloud_aio_v...db_conversion.html
B O 111.40 MB C 109.72 MB D 17519 N nextcloud_aio_v.../drag-and-drop.png
B O 123.99 MB C 120.23 MB D 17616 N nextcloud_aio_v...normal-italic.woff
B O 129.11 MB C 124.44 MB D 17714 N nextcloud_aio_v...toSans-Regular.ttf
B O 131.21 MB C 126.53 MB D 17901 N nextcloud_aio_v...ffice-document.svg
B O 133.73 MB C 129.05 MB D 17952 N nextcloud_aio_v...re/js/dist/main.js
B O 136.39 MB C 131.71 MB D 17959 N nextcloud_aio_v...mmendedapps.js.map
B O 138.49 MB C 133.65 MB D 18085 N nextcloud_aio_v.../core/l10n/oc.json
B O 151.42 MB C 146.58 MB D 18122 N nextcloud_aio_v...xtcloud Manual.pdf
B O 161.53 MB C 156.69 MB D 18194 N nextcloud_aio_v...vbn/dist/zxcvbn.js
B O 162.84 MB C 157.98 MB D 18415 N nextcloud_aio_v...ions/gardening.svg
B O 164.91 MB C 160.05 MB D 18494 N nextcloud_aio_v...onfirmation.js.map
B O 167.71 MB C 162.85 MB D 18503 N nextcloud_aio_v...r-dashboard.js.map
B O 170.34 MB C 165.48 MB D 18506 N nextcloud_aio_v...lendar-main.js.map
B O 171.88 MB C 167.01 MB D 18624 N nextcloud_aio_v...nt_locale_es_js.js
B O 172.29 MB C 167.42 MB D 18932 N nextcloud_aio_v...endar/l10n/cs.json
B O 173.29 MB C 168.37 MB D 19179 N nextcloud_aio_v...cts/img/social.svg
B O 175.39 MB C 170.47 MB D 19193 N nextcloud_aio_v...ntacts-main.js.map
B O 176.63 MB C 171.71 MB D 19414 N nextcloud_aio_v...230.js.LICENSE.txt
B O 177.23 MB C 172.26 MB D 19736 N nextcloud_aio_v...ts/l10n/pt_PT.json
B O 179.35 MB C 174.37 MB D 19853 N nextcloud_aio_v...k-dashboard.js.map
B O 182.63 MB C 177.65 MB D 19856 N nextcloud_aio_v...s/deck-main.js.map
B O 184.82 MB C 179.82 MB D 19955 N nextcloud_aio_v...ps/deck/l10n/he.js
B O 186.43 MB C 181.42 MB D 20226 N nextcloud_aio_v...arch64/notify_push
B O 191.22 MB C 186.22 MB D 20226 N nextcloud_aio_v...arch64/notify_push
B O 197.56 MB C 192.56 MB D 20227 N nextcloud_aio_v.../armv7/notify_push
B O 202.96 MB C 197.96 MB D 20228 N nextcloud_aio_v...x86_64/notify_push
B O 205.39 MB C 200.37 MB D 20347 N nextcloud_aio_v...ets/sv-SE/new.xlsx
B O 207.70 MB C 202.69 MB D 20471 N nextcloud_aio_v...s-dashboard.js.map
B O 210.30 MB C 205.28 MB D 20474 N nextcloud_aio_v.../tasks-main.js.map
B O 212.76 MB C 207.75 MB D 20477 N nextcloud_aio_v.../tasks-talk.js.map
B O 214.44 MB C 209.39 MB D 20654 N nextcloud_aio_v...login-setup.js.map
B O 215.19 MB C 210.10 MB D 20915 N nextcloud_aio_v...d/lib/l10n/el.json
B O 216.25 MB C 211.16 MB D 21249 N nextcloud_aio_v...oFactorCommand.php
B O 216.88 MB C 211.79 MB D 21596 N nextcloud_aio_v...w/Storage/Root.php
B O 217.27 MB C 212.18 MB D 21806 N nextcloud_aio_v...ertyCollection.php
B O 217.59 MB C 212.50 MB D 22083 N nextcloud_aio_v...he/ICacheEntry.php
B O 217.85 MB C 212.76 MB D 22357 N nextcloud_aio_v...erChangedEvent.php
B O 218.59 MB C 213.49 MB D 22550 N nextcloud_aio_v...tabase/base/1/2668
B O 219.69 MB C 214.00 MB D 22856 N nextcloud_aio_v...se/base/13755/2682
B O 221.09 MB C 214.07 MB D 23246 N nextcloud_aio_v...base/13756/3600_vm
B O 221.46 MB C 214.31 MB D 23794 N nextcloud_aio_v...e/base/16384/17353
B O 222.65 MB C 214.92 MB D 24267 N nextcloud_aio_v...010000000000000002
B O 224.80 MB C 217.07 MB D 24267 N nextcloud_aio_v...010000000000000002
B O 228.08 MB C 220.35 MB D 24268 N nextcloud_aio_v...010000000000000003
B O 230.90 MB C 220.42 MB D 24304 N nextcloud_aio_v...Photos/Gorilla.jpg
B O 235.87 MB C 220.42 MB D 24318 N nextcloud_aio_v...xtcloud Manual.pdf
B O 250.17 MB C 220.42 MB D 24319 N nextcloud_aio_v...extcloud intro.mp4
B O 252.16 MB C 222.40 MB D 24346 N nextcloud_aio_v...ctivity-sidebar.js
B O 252.89 MB C 223.13 MB D 24415 N nextcloud_aio_v...0/favIcon-calendar
ng segments   0%
ng segments  50%
iles cache
hunks cache
ache config
                                                                        
----------------------------------------------------------------------
Archive name: 20220524_095014-nextcloud-aio
Archive fingerprint: 308d1a43bbd4bbb13cc2c3e728bb100cc99732490410aaf239577277deeca16e
Time (start): Tue, 2022-05-24 09:50:14
Time (end):   Tue, 2022-05-24 09:50:42
Duration: 27.42 seconds
Number of files: 24426
Utilization of max. archive size: 0%
------------------------------------------------------------------------------
                       Original size      Compressed size    Deduplicated size
This archive:              749.61 MB            254.25 MB            224.47 MB
All archives:              749.61 MB            254.25 MB            224.47 MB

                       Unique chunks         Total chunks
Chunk index:                   21669                24257
------------------------------------------------------------------------------
Pruning the archives...

----------------------------------------------------------------------
                       Original size      Compressed size    Deduplicated size
Deleted data:                    0 B                  0 B                  0 B
All archives:              749.61 MB            254.25 MB            224.47 MB

                       Unique chunks         Total chunks
Chunk index:                   21669                24257
------------------------------------------------------------------------------
Backup finished successfully on 24.05.2022 - 09:50:43 (00 hours 00 minutes 29 seconds)

under /backup/borg is what looks like a standard borg repo structure:

$ sudo ls -l /backup/borg
total 1308
-rw------- 1 root root     965 May 24 11:50 config
drwx------ 3 root root    4096 May 24 11:50 data
-rw------- 1 root root      58 May 24 11:50 hints.4
-rw------- 1 root root 1310858 May 24 11:50 index.4
-rw------- 1 root root     190 May 24 11:50 integrity.4
-rw------- 1 root root      16 May 24 11:50 nonce
-rw------- 1 root root      73 May 24 11:50 README

[szaimen]

I am not sutr why but it seems like the config file was not successfully copied to the built-in volume. So please copy it to the volume with cp /backup/borg/config /var/lib/volumes/nextcloud_aio_mastercontainer/_data/data/borg.config , set the permissions correctly and it should allow you to continue.

[Waldorf3]

Well I deleted the nextcloud installation, removed all volumes, started over from scratch. (it was a new install with no user data anyway).
This time with a better understanding of how nextcloud sets this up I had all necessary folders and volumes created and with correct permissions, but still getting this error when I try to run a backup:

configuration.json not present. Cannot perform the backup!
/usr/bin/start.sh: line 42: /nextcloud_aio_volumes/nextcloud_aio_mastercontainer/data/backup_archives.list: No such file or directory
chmod: cannot access '/nextcloud_aio_volumes/nextcloud_aio_mastercontainer/data/backup_archives.list': No such file or directory

[szaimen]

configuration.json not present. Cannot perform the backup!

What was the docker run command that you used?

[Waldorf3]

I use docker-compose, and nginx-proxy-manager as ingress manager.

version: "3.8"

volumes:
  nextcloud_aio_mastercontainer:
    name: nextcloud_aio_mastercontainer

services:
  nextcloud:
    image: nextcloud/all-in-one:latest
    restart: unless-stopped
    container_name: nextcloud-aio-mastercontainer
    volumes:
      - ./docker-aio-config:/mnt/docker-aio-config
      - /var/run/docker.sock:/var/run/docker.sock:ro
    ports:
      - 8083:8080
    environment:
      - APACHE_PORT=8084
      - NEXTCLOUD_DATADIR=/homes/ncdata/

[szaimen]

• ./docker-aio-config:/mnt/docker-aio-config

This is why the backup fails. The backup container expects the mastercontainer files inside the mastercontainer volume...

[Waldorf3]

Hm, yes that would explain it. I normally prefer to mount data volumes to the host so I can get to the data directly. Any particular reason for this limitation?

[Waldorf3]

I changed it to a volume, and now I get this error:

Configuring Redis as session handler
touch: /mnt/ncdata/this-is-a-test-file: Permission denied
The www-data user doesn't seem to have access rights in /mnt/ncdata.
Did you maybe change the datadir and did forget to apply the correct permissions?

Why is it trying to create files under /mnt? I know your examples suggest it, but /mnt is only meant for temporary/ad-hoc mounts. I have my ncdata under /homes, and have configured it as such ( as you can see in my docker-compose.yml above).

Why the monolithic setup with a docker container loading others? It makes it very hard and un-transparent to debug. Normally even very complicated docker projects are configured in a docker-compose and run as a stack. It also makes it complicated to shut it down. Normally I'd just do a docker-compose down, and everything goes down. Now just the controller goes down and I have to kill each of the remaining containers manually one by one.

[szaimen]

You are free running it using the manual install option: https://github.com/nextcloud/all-in-one/tree/main/manual-install

[szaimen]

This will be handled in #722