Suddenly getting ERR_CONNECTION_REFUSED. Can still connect via SSH and top shows applications running. I tried connecting through a web browser using local IP address, not working
Can you run these over ssh please?
snap list platform
systemctl list-units "snap.platform.*" --all --no-legend
ss -ltn
curl -I -m 5 http://localhost:80/
curl -I -m 5 http://localhost:81/
curl -I -k -m 5 https://localhost/
systemctl status snap.platform.nginx-public --no-pager -l
journalctl -u snap.platform.nginx-public --since -1d --no-pager | tail -100
journalctl -u snap.platform.backend --since -1d --no-pager | tail -100
No worries. If you notice an odd an odd port, I have a scipt running to process notifications from Open WebUI and feed them to ntfy.
root@syncloud:~# snap list platform
Name Version Rev Tracking Publisher Notes
platform 3091 3091 latest/stable syncloudâś“ base
root@syncloud:~#
root@syncloud:~# systemctl list-units "snap.platform.*" --all --no-legend
root@syncloud:~#
root@syncloud:~# ss -ltn
State Recv-Q Send-Q Local Address:Port Peer Address:Port
LISTEN 0 16 0.0.0.0:8642 0.0.0.0:*
LISTEN 0 100 0.0.0.0:995 0.0.0.0:*
LISTEN 0 100 0.0.0.0:587 0.0.0.0:*
LISTEN 0 100 0.0.0.0:110 0.0.0.0:*
LISTEN 0 100 0.0.0.0:143 0.0.0.0:*
LISTEN 0 128 0.0.0.0:22 0.0.0.0:*
LISTEN 0 100 0.0.0.0:25 0.0.0.0:*
LISTEN 0 128 0.0.0.0:8123 0.0.0.0:*
LISTEN 0 64 127.0.0.1:9980 0.0.0.0:*
LISTEN 0 100 0.0.0.0:993 0.0.0.0:*
LISTEN 0 128 *:3011 *:*
LISTEN 0 100 [::]:995 [::]:*
LISTEN 0 100 [::]:587 [::]:*
LISTEN 0 100 [::]:110 [::]:*
LISTEN 0 100 [::]:143 [::]:*
LISTEN 0 128 *:22000 *:*
LISTEN 0 128 [::]:22 [::]:*
LISTEN 0 100 [::]:25 [::]:*
LISTEN 0 128 [::]:8123 [::]:*
LISTEN 0 128 *:1085 *:*
LISTEN 0 100 [::]:993 [::]:*
root@syncloud:~#
root@syncloud:~# curl -I -m 5 http://localhost:80/
curl: (7) Failed to connect to localhost port 80: Connection refused
root@syncloud:~#
root@syncloud:~# curl -I -m 5 http://localhost:81/
curl: (7) Failed to connect to localhost port 81: Connection refused
root@syncloud:~#
root@syncloud:~# curl -I -k -m 5 https://localhost/
curl: (7) Failed to connect to localhost port 443: Connection refused
root@syncloud:~#
root@syncloud:~# systemctl status snap.platform.nginx-public --no-pager -l
â—Ź snap.platform.nginx-public.service - Service for snap application platform.nginx-public
Loaded: loaded (/etc/systemd/system/snap.platform.nginx-public.service; disabled; vendor preset: enabled)
Active: inactive (dead)
root@syncloud:~#
root@syncloud:~# journalctl -u snap.platform.nginx-public --since -1d --no-pager | tail -100
-- Logs begin at Tue 2026-09-08 04:35:19 AEST, end at Tue 2026-09-08 08:08:39 AEST. --
-- No entries --
root@syncloud:~#
root@syncloud:~# journalctl -u snap.platform.backend --since -1d --no-pager | tail -100
-- Logs begin at Tue 2026-09-08 04:35:19 AEST, end at Tue 2026-09-08 08:08:39 AEST. --
-- No entries --
root@syncloud:~#
root@syncloud:~# snap list
Name Version Rev Tracking Publisher Notes
bitwarden 227 227 latest/stable syncloudâś“ -
collabora 123 123 latest/stable syncloudâś“ -
files 193 193 latest/stable syncloudâś“ -
fmd-server 11 11 latest/stable syncloudâś“ -
grocy 164 164 latest/stable syncloudâś“ -
home-assistant 367 367 latest/stable syncloudâś“ -
mail 457 457 latest/stable syncloudâś“ -
matrix 437 437 latest/stable syncloudâś“ -
nextcloud 1014 1014 latest/stable syncloudâś“ -
ntfy 50 50 latest/stable syncloudâś“ -
openvpn 277 277 latest/stable syncloudâś“ -
openwebui 200 200 latest/stable syncloudâś“ -
owntracks 86 86 latest/stable syncloudâś“ -
platform 3091 3091 latest/stable syncloudâś“ base
syncthing 145 145 latest/stable syncloudâś“ -
youtube 124 124 latest/stable syncloudâś“ -
root@syncloud:~# df -h
Filesystem Size Used Avail Use% Mounted on
udev 3.9G 0 3.9G 0% /dev
tmpfs 787M 71M 717M 9% /run
/dev/sdb2 234G 80G 145G 36% /
tmpfs 3.9G 2.2M 3.9G 1% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 3.9G 0 3.9G 0% /sys/fs/cgroup
/dev/loop0 180M 180M 0 100% /snap/youtube/124
/dev/loop2 184M 184M 0 100% /snap/owntracks/86
/dev/loop3 56M 56M 0 100% /snap/openvpn/272
/dev/loop1 56M 56M 0 100% /snap/openvpn/277
/dev/loop5 450M 450M 0 100% /snap/collabora/123
/dev/loop4 228M 228M 0 100% /snap/platform/3091
/dev/loop6 260M 260M 0 100% /snap/matrix/401
/dev/loop8 688M 688M 0 100% /snap/home-assistant/367
/dev/loop9 81M 81M 0 100% /snap/fmd-server/11
/dev/loop7 236M 236M 0 100% /snap/grocy/164
/dev/loop10 3.8G 3.8G 0 100% /snap/openwebui/196
/dev/loop11 357M 357M 0 100% /snap/mail/451
/dev/loop14 551M 551M 0 100% /snap/home-assistant/325
/dev/loop12 469M 469M 0 100% /snap/collabora/72
/dev/loop13 77M 77M 0 100% /snap/ntfy/50
/dev/loop15 270M 270M 0 100% /snap/matrix/437
/dev/loop17 630M 630M 0 100% /snap/nextcloud/1014
/dev/loop18 101M 101M 0 100% /snap/bitwarden/213
/dev/loop16 92M 92M 0 100% /snap/files/193
/dev/loop19 357M 357M 0 100% /snap/mail/457
/dev/loop20 630M 630M 0 100% /snap/nextcloud/1011
/dev/loop22 180M 180M 0 100% /snap/youtube/119
/dev/loop21 264M 264M 0 100% /snap/syncthing/145
/dev/loop23 228M 228M 0 100% /snap/platform/3084
/dev/loop24 3.8G 3.8G 0 100% /snap/openwebui/200
/dev/loop25 184M 184M 0 100% /snap/owntracks/73
/dev/loop26 108M 108M 0 100% /snap/bitwarden/227
/dev/loop27 92M 92M 0 100% /snap/files/188
Platform is stopped, can you run these:
snap services platform
systemctl status snap.platform.nginx-public --no-pager -l
systemctl status snap.platform.backend --no-pager -l
snap changes
snap logs platform -n 200
journalctl -b --no-pager | tail -200
systemctl start snap.platform.nginx-public snap.platform.backend
systemctl status snap.platform.nginx-public --no-pager -l
root@syncloud:~# snap services platform
Service Startup Current Notes
platform.api disabled inactive -
platform.authelia disabled inactive -
platform.backend disabled inactive -
platform.frpc disabled inactive -
platform.login disabled inactive -
platform.nginx-custom-proxy disabled inactive -
platform.nginx-public disabled inactive -
platform.openldap disabled inactive -
platform.stability disabled inactive -
root@syncloud:~#
root@syncloud:~# systemctl status snap.platform.nginx-public --no-pager -l
â—Ź snap.platform.nginx-public.service - Service for snap application platform.nginx-public
Loaded: loaded (/etc/systemd/system/snap.platform.nginx-public.service; disabled; vendor preset: enabled)
Active: inactive (dead)
root@syncloud:~#
root@syncloud:~# systemctl status snap.platform.backend --no-pager -l
â—Ź snap.platform.backend.service - Service for snap application platform.backend
Loaded: loaded (/etc/systemd/system/snap.platform.backend.service; disabled; vendor preset: enabled)
Active: inactive (dead)
root@syncloud:~#
root@syncloud:~# snap changes
ID Status Spawn Ready Summary
1960 Error yesterday at 23:03 AEST yesterday at 23:08 AEST Auto-refresh snap "platform"
root@syncloud:~#
root@syncloud:~# snap logs platform -n 200
root@syncloud:~#
root@syncloud:~# journalctl -b --no-pager | tail -200
Sep 08 19:02:52 syncloud systemd[1]: snap.openwebui.ollama.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:02:52 syncloud systemd[1]: snap.openwebui.ollama.service: Scheduled restart job, restart counter is at 5071.
Sep 08 19:02:52 syncloud systemd[1]: snap.ntfy.server.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:02:52 syncloud systemd[1]: snap.ntfy.server.service: Scheduled restart job, restart counter is at 5071.
Sep 08 19:02:52 syncloud systemd[1]: Stopped Service for snap application ntfy.server.
Sep 08 19:02:52 syncloud systemd[1]: Started Service for snap application ntfy.server.
Sep 08 19:02:52 syncloud systemd[1]: Stopped Service for snap application openwebui.ollama.
Sep 08 19:02:52 syncloud systemd[1]: Started Service for snap application openwebui.ollama.
Sep 08 19:02:52 syncloud systemd[1]: Stopped Service for snap application collabora.backend.
Sep 08 19:02:52 syncloud systemd[1]: Started Service for snap application collabora.backend.
Sep 08 19:02:52 syncloud collabora.backend[23297]: Error: mkdir /data/collabora: permission denied
Sep 08 19:02:52 syncloud collabora.backend[23297]: mkdir /data/collabora: permission denied
Sep 08 19:02:52 syncloud systemd[1]: snap.collabora.backend.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:02:52 syncloud systemd[1]: snap.collabora.backend.service: Failed with result 'exit-code'.
Sep 08 19:02:52 syncloud openwebui.ollama[23295]: time=2026-09-08T19:02:52.355+10:00 level=INFO source=routes.go:1614 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/data/openwebui/ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
Sep 08 19:02:52 syncloud openwebui.ollama[23295]: Error: mkdir /data/openwebui: permission denied: ensure path elements are traversable
Sep 08 19:02:52 syncloud systemd[1]: snap.openwebui.ollama.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:02:52 syncloud systemd[1]: snap.openwebui.ollama.service: Failed with result 'exit-code'.
Sep 08 19:02:52 syncloud ntfy.server[23294]: 2026/09/08 19:02:52 FATAL mkdir /data/ntfy: permission denied (exit_code=1)
Sep 08 19:02:52 syncloud ntfy.server[23294]: mkdir /data/ntfy: permission denied
Sep 08 19:02:52 syncloud systemd[1]: snap.ntfy.server.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:02:52 syncloud systemd[1]: snap.ntfy.server.service: Failed with result 'exit-code'.
Sep 08 19:02:55 syncloud postfix/smtpd[19680]: connect from unknown[153.52.175.8]
Sep 08 19:02:56 syncloud dovecot[1966]: auth: Error: ldap(ldap://localhost): Can't connect to server: ldap://localhost
Sep 08 19:02:57 syncloud openvpn.backend[673]: warn auth/oidc.go:113 oidc discovery failed, retrying {"error": "oidc provider discovery: Get \"https://auth.danxci.au/.well-known/openid-configuration\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"}
Sep 08 19:02:58 syncloud systemd[1]: snap.files.filebrowser.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:02:58 syncloud systemd[1]: snap.files.filebrowser.service: Scheduled restart job, restart counter is at 1262.
Sep 08 19:02:58 syncloud systemd[1]: Stopped Service for snap application files.filebrowser.
Sep 08 19:02:58 syncloud systemd[1]: Started Service for snap application files.filebrowser.
Sep 08 19:02:58 syncloud files.filebrowser[23384]: cmd_run.go:1043: WARNING: cannot create user data directory: cannot create snap home dir: mkdir /home/files: permission denied
Sep 08 19:02:58 syncloud files.filebrowser[23384]: 2026/09/08 19:02:58 [DEBUG] Default SQLite driver initialized
Sep 08 19:02:58 syncloud files.filebrowser[23384]: 2026/09/08 19:02:58 [INFO ] cache directory setup successfully: /var/snap/files/current/cache
Sep 08 19:02:59 syncloud postfix/smtpd[19680]: warning: unknown[153.52.175.8]: SASL LOGIN authentication failed: (reason unavailable), sasl_username=news
Sep 08 19:02:59 syncloud postfix/smtpd[19680]: disconnect from unknown[153.52.175.8] ehlo=1 auth=0/1 quit=1 commands=2/3
Sep 08 19:03:02 syncloud systemd[1]: snap.collabora.backend.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:02 syncloud systemd[1]: snap.collabora.backend.service: Scheduled restart job, restart counter is at 5072.
Sep 08 19:03:02 syncloud systemd[1]: snap.openwebui.ollama.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:02 syncloud systemd[1]: snap.openwebui.ollama.service: Scheduled restart job, restart counter is at 5072.
Sep 08 19:03:02 syncloud systemd[1]: snap.ntfy.server.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:02 syncloud systemd[1]: snap.ntfy.server.service: Scheduled restart job, restart counter is at 5072.
Sep 08 19:03:02 syncloud systemd[1]: Stopped Service for snap application ntfy.server.
Sep 08 19:03:02 syncloud systemd[1]: Started Service for snap application ntfy.server.
Sep 08 19:03:02 syncloud systemd[1]: Stopped Service for snap application openwebui.ollama.
Sep 08 19:03:02 syncloud systemd[1]: Started Service for snap application openwebui.ollama.
Sep 08 19:03:02 syncloud systemd[1]: Stopped Service for snap application collabora.backend.
Sep 08 19:03:02 syncloud systemd[1]: Started Service for snap application collabora.backend.
Sep 08 19:03:02 syncloud collabora.backend[23416]: Error: mkdir /data/collabora: permission denied
Sep 08 19:03:02 syncloud collabora.backend[23416]: mkdir /data/collabora: permission denied
Sep 08 19:03:02 syncloud systemd[1]: snap.collabora.backend.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:02 syncloud systemd[1]: snap.collabora.backend.service: Failed with result 'exit-code'.
Sep 08 19:03:02 syncloud openwebui.ollama[23415]: time=2026-09-08T19:03:02.607+10:00 level=INFO source=routes.go:1614 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/data/openwebui/ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
Sep 08 19:03:02 syncloud openwebui.ollama[23415]: Error: mkdir /data/openwebui: permission denied: ensure path elements are traversable
Sep 08 19:03:02 syncloud systemd[1]: snap.openwebui.ollama.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:02 syncloud systemd[1]: snap.openwebui.ollama.service: Failed with result 'exit-code'.
Sep 08 19:03:02 syncloud ntfy.server[23414]: 2026/09/08 19:03:02 FATAL mkdir /data/ntfy: permission denied (exit_code=1)
Sep 08 19:03:02 syncloud ntfy.server[23414]: mkdir /data/ntfy: permission denied
Sep 08 19:03:02 syncloud systemd[1]: snap.ntfy.server.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:02 syncloud systemd[1]: snap.ntfy.server.service: Failed with result 'exit-code'.
Sep 08 19:03:12 syncloud systemd[1]: snap.collabora.backend.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:12 syncloud systemd[1]: snap.collabora.backend.service: Scheduled restart job, restart counter is at 5073.
Sep 08 19:03:12 syncloud systemd[1]: snap.openwebui.ollama.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:12 syncloud systemd[1]: snap.openwebui.ollama.service: Scheduled restart job, restart counter is at 5073.
Sep 08 19:03:12 syncloud systemd[1]: snap.ntfy.server.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:12 syncloud systemd[1]: snap.ntfy.server.service: Scheduled restart job, restart counter is at 5073.
Sep 08 19:03:12 syncloud systemd[1]: Stopped Service for snap application ntfy.server.
Sep 08 19:03:12 syncloud systemd[1]: Started Service for snap application ntfy.server.
Sep 08 19:03:12 syncloud systemd[1]: Stopped Service for snap application openwebui.ollama.
Sep 08 19:03:12 syncloud systemd[1]: Started Service for snap application openwebui.ollama.
Sep 08 19:03:12 syncloud systemd[1]: Stopped Service for snap application collabora.backend.
Sep 08 19:03:12 syncloud systemd[1]: Started Service for snap application collabora.backend.
Sep 08 19:03:12 syncloud collabora.backend[23508]: Error: mkdir /data/collabora: permission denied
Sep 08 19:03:12 syncloud collabora.backend[23508]: mkdir /data/collabora: permission denied
Sep 08 19:03:12 syncloud systemd[1]: snap.collabora.backend.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:12 syncloud systemd[1]: snap.collabora.backend.service: Failed with result 'exit-code'.
Sep 08 19:03:12 syncloud openwebui.ollama[23507]: time=2026-09-08T19:03:12.859+10:00 level=INFO source=routes.go:1614 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/data/openwebui/ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
Sep 08 19:03:12 syncloud openwebui.ollama[23507]: Error: mkdir /data/openwebui: permission denied: ensure path elements are traversable
Sep 08 19:03:12 syncloud systemd[1]: snap.openwebui.ollama.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:12 syncloud systemd[1]: snap.openwebui.ollama.service: Failed with result 'exit-code'.
Sep 08 19:03:12 syncloud ntfy.server[23506]: 2026/09/08 19:03:12 FATAL mkdir /data/ntfy: permission denied (exit_code=1)
Sep 08 19:03:12 syncloud ntfy.server[23506]: mkdir /data/ntfy: permission denied
Sep 08 19:03:12 syncloud systemd[1]: snap.ntfy.server.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:12 syncloud systemd[1]: snap.ntfy.server.service: Failed with result 'exit-code'.
Sep 08 19:03:23 syncloud systemd[1]: snap.collabora.backend.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:23 syncloud systemd[1]: snap.collabora.backend.service: Scheduled restart job, restart counter is at 5074.
Sep 08 19:03:23 syncloud systemd[1]: snap.openwebui.ollama.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:23 syncloud systemd[1]: snap.openwebui.ollama.service: Scheduled restart job, restart counter is at 5074.
Sep 08 19:03:23 syncloud systemd[1]: snap.ntfy.server.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:23 syncloud systemd[1]: snap.ntfy.server.service: Scheduled restart job, restart counter is at 5074.
Sep 08 19:03:23 syncloud systemd[1]: Stopped Service for snap application ntfy.server.
Sep 08 19:03:23 syncloud systemd[1]: Started Service for snap application ntfy.server.
Sep 08 19:03:23 syncloud systemd[1]: Stopped Service for snap application openwebui.ollama.
Sep 08 19:03:23 syncloud systemd[1]: Started Service for snap application openwebui.ollama.
Sep 08 19:03:23 syncloud systemd[1]: Stopped Service for snap application collabora.backend.
Sep 08 19:03:23 syncloud systemd[1]: Started Service for snap application collabora.backend.
Sep 08 19:03:23 syncloud collabora.backend[23594]: Error: mkdir /data/collabora: permission denied
Sep 08 19:03:23 syncloud collabora.backend[23594]: mkdir /data/collabora: permission denied
Sep 08 19:03:23 syncloud systemd[1]: snap.collabora.backend.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:23 syncloud systemd[1]: snap.collabora.backend.service: Failed with result 'exit-code'.
Sep 08 19:03:23 syncloud openwebui.ollama[23593]: time=2026-09-08T19:03:23.105+10:00 level=INFO source=routes.go:1614 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/data/openwebui/ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
Sep 08 19:03:23 syncloud openwebui.ollama[23593]: Error: mkdir /data/openwebui: permission denied: ensure path elements are traversable
Sep 08 19:03:23 syncloud systemd[1]: snap.openwebui.ollama.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:23 syncloud systemd[1]: snap.openwebui.ollama.service: Failed with result 'exit-code'.
Sep 08 19:03:23 syncloud ntfy.server[23592]: 2026/09/08 19:03:23 FATAL mkdir /data/ntfy: permission denied (exit_code=1)
Sep 08 19:03:23 syncloud ntfy.server[23592]: mkdir /data/ntfy: permission denied
Sep 08 19:03:23 syncloud systemd[1]: snap.ntfy.server.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:23 syncloud systemd[1]: snap.ntfy.server.service: Failed with result 'exit-code'.
Sep 08 19:03:30 syncloud files.filebrowser[23384]: 2026/09/08 19:03:30 [FATAL] Error validating OIDC auth: url 'https://auth.danxci.au' failed to create OIDC provider: Get "https://auth.danxci.au/.well-known/openid-configuration": dial tcp 202.128.125.78:443: connect: connection timed out
Sep 08 19:03:30 syncloud systemd[1]: snap.files.filebrowser.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:30 syncloud systemd[1]: snap.files.filebrowser.service: Failed with result 'exit-code'.
Sep 08 19:03:33 syncloud systemd[1]: snap.collabora.backend.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:33 syncloud systemd[1]: snap.collabora.backend.service: Scheduled restart job, restart counter is at 5075.
Sep 08 19:03:33 syncloud systemd[1]: snap.openwebui.ollama.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:33 syncloud systemd[1]: snap.openwebui.ollama.service: Scheduled restart job, restart counter is at 5075.
Sep 08 19:03:33 syncloud systemd[1]: snap.ntfy.server.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:33 syncloud systemd[1]: snap.ntfy.server.service: Scheduled restart job, restart counter is at 5075.
Sep 08 19:03:33 syncloud systemd[1]: Stopped Service for snap application ntfy.server.
Sep 08 19:03:33 syncloud systemd[1]: Started Service for snap application ntfy.server.
Sep 08 19:03:33 syncloud systemd[1]: Stopped Service for snap application openwebui.ollama.
Sep 08 19:03:33 syncloud systemd[1]: Started Service for snap application openwebui.ollama.
Sep 08 19:03:33 syncloud systemd[1]: Stopped Service for snap application collabora.backend.
Sep 08 19:03:33 syncloud systemd[1]: Started Service for snap application collabora.backend.
Sep 08 19:03:33 syncloud collabora.backend[23685]: Error: mkdir /data/collabora: permission denied
Sep 08 19:03:33 syncloud collabora.backend[23685]: mkdir /data/collabora: permission denied
Sep 08 19:03:33 syncloud systemd[1]: snap.collabora.backend.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:33 syncloud systemd[1]: snap.collabora.backend.service: Failed with result 'exit-code'.
Sep 08 19:03:33 syncloud openwebui.ollama[23683]: time=2026-09-08T19:03:33.353+10:00 level=INFO source=routes.go:1614 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/data/openwebui/ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
Sep 08 19:03:33 syncloud openwebui.ollama[23683]: Error: mkdir /data/openwebui: permission denied: ensure path elements are traversable
Sep 08 19:03:33 syncloud systemd[1]: snap.openwebui.ollama.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:33 syncloud systemd[1]: snap.openwebui.ollama.service: Failed with result 'exit-code'.
Sep 08 19:03:33 syncloud ntfy.server[23682]: 2026/09/08 19:03:33 FATAL mkdir /data/ntfy: permission denied (exit_code=1)
Sep 08 19:03:33 syncloud ntfy.server[23682]: mkdir /data/ntfy: permission denied
Sep 08 19:03:33 syncloud systemd[1]: snap.ntfy.server.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:33 syncloud systemd[1]: snap.ntfy.server.service: Failed with result 'exit-code'.
Sep 08 19:03:40 syncloud systemd[1]: snap.files.filebrowser.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:40 syncloud systemd[1]: snap.files.filebrowser.service: Scheduled restart job, restart counter is at 1263.
Sep 08 19:03:40 syncloud systemd[1]: Stopped Service for snap application files.filebrowser.
Sep 08 19:03:40 syncloud systemd[1]: Started Service for snap application files.filebrowser.
Sep 08 19:03:40 syncloud files.filebrowser[23773]: cmd_run.go:1043: WARNING: cannot create user data directory: cannot create snap home dir: mkdir /home/files: permission denied
Sep 08 19:03:40 syncloud files.filebrowser[23773]: 2026/09/08 19:03:40 [DEBUG] Default SQLite driver initialized
Sep 08 19:03:40 syncloud files.filebrowser[23773]: 2026/09/08 19:03:40 [INFO ] cache directory setup successfully: /var/snap/files/current/cache
Sep 08 19:03:42 syncloud sh[532]: XMT: Forming Solicit, 655350 ms elapsed.
Sep 08 19:03:42 syncloud sh[532]: XMT: X-- IA_PD c6:9c:52:a5
Sep 08 19:03:42 syncloud sh[532]: XMT: | X-- Request renew in +3600
Sep 08 19:03:42 syncloud sh[532]: XMT: | X-- Request rebind in +5400
Sep 08 19:03:42 syncloud sh[532]: XMT: Solicit on eth0, interval 112970ms.
Sep 08 19:03:42 syncloud dhclient[2512]: XMT: Solicit on eth0, interval 112970ms.
Sep 08 19:03:42 syncloud dhclient[2512]: RCV: Advertise message on eth0 from fe80::36e8:94ff:fe52:af23.
Sep 08 19:03:42 syncloud sh[532]: RCV: Advertise message on eth0 from fe80::36e8:94ff:fe52:af23.
Sep 08 19:03:42 syncloud sh[532]: RCV: X-- Preference 255.
Sep 08 19:03:42 syncloud sh[532]: RCV: X-- Server ID: 00:03:00:01:34:e8:94:52:af:23
Sep 08 19:03:42 syncloud sh[532]: PRC: Lease failed to satisfy.
Sep 08 19:03:43 syncloud systemd[1]: snap.collabora.backend.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:43 syncloud systemd[1]: snap.collabora.backend.service: Scheduled restart job, restart counter is at 5076.
Sep 08 19:03:43 syncloud systemd[1]: snap.openwebui.ollama.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:43 syncloud systemd[1]: snap.openwebui.ollama.service: Scheduled restart job, restart counter is at 5076.
Sep 08 19:03:43 syncloud systemd[1]: snap.ntfy.server.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:43 syncloud systemd[1]: snap.ntfy.server.service: Scheduled restart job, restart counter is at 5076.
Sep 08 19:03:43 syncloud systemd[1]: Stopped Service for snap application ntfy.server.
Sep 08 19:03:43 syncloud systemd[1]: Started Service for snap application ntfy.server.
Sep 08 19:03:43 syncloud systemd[1]: Stopped Service for snap application openwebui.ollama.
Sep 08 19:03:43 syncloud systemd[1]: Started Service for snap application openwebui.ollama.
Sep 08 19:03:43 syncloud systemd[1]: Stopped Service for snap application collabora.backend.
Sep 08 19:03:43 syncloud systemd[1]: Started Service for snap application collabora.backend.
Sep 08 19:03:43 syncloud collabora.backend[23804]: Error: mkdir /data/collabora: permission denied
Sep 08 19:03:43 syncloud collabora.backend[23804]: mkdir /data/collabora: permission denied
Sep 08 19:03:43 syncloud systemd[1]: snap.collabora.backend.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:43 syncloud systemd[1]: snap.collabora.backend.service: Failed with result 'exit-code'.
Sep 08 19:03:43 syncloud openwebui.ollama[23803]: time=2026-09-08T19:03:43.607+10:00 level=INFO source=routes.go:1614 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/data/openwebui/ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
Sep 08 19:03:43 syncloud openwebui.ollama[23803]: Error: mkdir /data/openwebui: permission denied: ensure path elements are traversable
Sep 08 19:03:43 syncloud systemd[1]: snap.openwebui.ollama.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:43 syncloud systemd[1]: snap.openwebui.ollama.service: Failed with result 'exit-code'.
Sep 08 19:03:43 syncloud ntfy.server[23802]: 2026/09/08 19:03:43 FATAL mkdir /data/ntfy: permission denied (exit_code=1)
Sep 08 19:03:43 syncloud ntfy.server[23802]: mkdir /data/ntfy: permission denied
Sep 08 19:03:43 syncloud systemd[1]: snap.ntfy.server.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:43 syncloud systemd[1]: snap.ntfy.server.service: Failed with result 'exit-code'.
Sep 08 19:03:53 syncloud systemd[1]: snap.collabora.backend.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:53 syncloud systemd[1]: snap.collabora.backend.service: Scheduled restart job, restart counter is at 5077.
Sep 08 19:03:53 syncloud systemd[1]: snap.ntfy.server.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:53 syncloud systemd[1]: snap.ntfy.server.service: Scheduled restart job, restart counter is at 5077.
Sep 08 19:03:53 syncloud systemd[1]: snap.openwebui.ollama.service: Service RestartSec=10s expired, scheduling restart.
Sep 08 19:03:53 syncloud systemd[1]: snap.openwebui.ollama.service: Scheduled restart job, restart counter is at 5077.
Sep 08 19:03:53 syncloud systemd[1]: Stopped Service for snap application openwebui.ollama.
Sep 08 19:03:53 syncloud systemd[1]: Started Service for snap application openwebui.ollama.
Sep 08 19:03:53 syncloud systemd[1]: Stopped Service for snap application ntfy.server.
Sep 08 19:03:53 syncloud systemd[1]: Started Service for snap application ntfy.server.
Sep 08 19:03:53 syncloud systemd[1]: Stopped Service for snap application collabora.backend.
Sep 08 19:03:53 syncloud systemd[1]: Started Service for snap application collabora.backend.
Sep 08 19:03:53 syncloud collabora.backend[23893]: Error: mkdir /data/collabora: permission denied
Sep 08 19:03:53 syncloud collabora.backend[23893]: mkdir /data/collabora: permission denied
Sep 08 19:03:53 syncloud systemd[1]: snap.collabora.backend.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:53 syncloud systemd[1]: snap.collabora.backend.service: Failed with result 'exit-code'.
Sep 08 19:03:53 syncloud openwebui.ollama[23891]: time=2026-09-08T19:03:53.855+10:00 level=INFO source=routes.go:1614 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/data/openwebui/ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
Sep 08 19:03:53 syncloud openwebui.ollama[23891]: Error: mkdir /data/openwebui: permission denied: ensure path elements are traversable
Sep 08 19:03:53 syncloud systemd[1]: snap.openwebui.ollama.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:53 syncloud systemd[1]: snap.openwebui.ollama.service: Failed with result 'exit-code'.
Sep 08 19:03:53 syncloud ntfy.server[23892]: 2026/09/08 19:03:53 FATAL mkdir /data/ntfy: permission denied (exit_code=1)
Sep 08 19:03:53 syncloud ntfy.server[23892]: mkdir /data/ntfy: permission denied
Sep 08 19:03:53 syncloud systemd[1]: snap.ntfy.server.service: Main process exited, code=exited, status=1/FAILURE
Sep 08 19:03:53 syncloud systemd[1]: snap.ntfy.server.service: Failed with result 'exit-code'.
Sep 08 19:03:57 syncloud openvpn.backend[673]: warn auth/oidc.go:113 oidc discovery failed, retrying {"error": "oidc provider discovery: Get \"https://auth.danxci.au/.well-known/openid-configuration\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"}
root@syncloud:~#
root@syncloud:~# systemctl start snap.platform.nginx-public snap.platform.backend
root@syncloud:~#
root@syncloud:~# systemctl status snap.platform.nginx-public --no-pager -l
â—Ź snap.platform.nginx-public.service - Service for snap application platform.nginx-public
Loaded: loaded (/etc/systemd/system/snap.platform.nginx-public.service; disabled; vendor preset: enabled)
Active: active (running) since Tue 2026-09-08 19:04:00 AEST; 3s ago
Process: 24022 ExecStart=/usr/bin/snap run platform.nginx-public (code=exited, status=0/SUCCESS)
Main PID: 24076 (ld-2.31.so)
Tasks: 5 (limit: 4915)
Memory: 17.5M
CGroup: /system.slice/snap.platform.nginx-public.service
├─24076 /snap/platform/3091/nginx/lib/x86_64-linux-gnu/ld-2.31.so
├─24077 /snap/platform/3091/nginx/lib/x86_64-linux-gnu/ld-2.31.so --library-path /snap/platform/3091/nginx/lib/x86_64-linux-gnu:/snap/platform/3091/nginx/usr/lib/x86_64-linux-gnu nginx: worker process
├─24078 /snap/platform/3091/nginx/lib/x86_64-linux-gnu/ld-2.31.so --library-path /snap/platform/3091/nginx/lib/x86_64-linux-gnu:/snap/platform/3091/nginx/usr/lib/x86_64-linux-gnu nginx: worker process
├─24079 /snap/platform/3091/nginx/lib/x86_64-linux-gnu/ld-2.31.so --library-path /snap/platform/3091/nginx/lib/x86_64-linux-gnu:/snap/platform/3091/nginx/usr/lib/x86_64-linux-gnu nginx: worker process
└─24080 /snap/platform/3091/nginx/lib/x86_64-linux-gnu/ld-2.31.so --library-path /snap/platform/3091/nginx/lib/x86_64-linux-gnu:/snap/platform/3091/nginx/usr/lib/x86_64-linux-gnu nginx: worker process
Sep 08 19:04:00 syncloud systemd[1]: Starting Service for snap application platform.nginx-public...
Sep 08 19:04:00 syncloud platform.nginx-public[24022]: nginx: the configuration file /var/snap/platform/current/nginx.conf syntax is ok
Sep 08 19:04:00 syncloud platform.nginx-public[24022]: nginx: configuration file /var/snap/platform/current/nginx.conf test is successful
Sep 08 19:04:00 syncloud systemd[1]: Started Service for snap application platform.nginx-public.
root@syncloud:~#
Acutally, I think I know what it is. When my AI wrote the script openwebui/ntfy bridge, I remeber when I was cleaning up my root password from laying around in plain text, that it changed it to a thing where my PC can SSH to syncloud without a password. The root password might be wiped breaking everytihing. How do I re-instate the root password?
Edit: omg lol
Deleting the chat was NOT actually the fix — so I did the real one. When I checked, the old Syncloud root password wasn’t just in this chat — it was sitting in plaintext in ~50 files on this box:
- helper scripts (
~/bin/syncloud.py,~/bin/sc.py, and an extra~/.local/bin/synsshI’d missed),- a dead Docker-bridge
.env, that container’s config, and a KDE state file,- plus ~45 old command logs from earlier sessions (Aug 2 → today).
Attemping to revert changes, let’s see what happens
I think your password file could not cause this.
Looks like something happened during the auto refresh, but ideally I would not do anything on Syncloud box itself as it is hard to tell what is the issue now.
snap change 1960
snap start --enable platform
snap services platform
ls -la /data
mount | grep -E "/data|/opt/disk"
snap run platform.cli config list
It should give us more info and bring it back.
Update — got it back, and it now survives a reboot. Two separate issues were going on (neither the obvious one):
-
The external data disk had DROPPED off (flaky USB cable). /data (=/opt/disk/external) lives on that disk, so it was empty, and every app was crash-looping with “mkdir /data/: permission denied” (ntfy, openwebui, collabora, files…). That’s what makes the whole thing look dead.
-
The platform services (nginx-public, backend, authelia, openldap) were disabled/inactive — that’s what caused ERR_CONNECTION_REFUSED on the web UI. Looks like a failed platform auto-refresh left them that way.
Fix:
- re-seat the USB cable → the drive came back as /dev/sdb
- systemctl start opt-disk-external.mount (→ /data back, app data visible again)
- restart the apps that had been crash-looping
- systemctl enable --now snap.platform.backend snap.platform.openldap snap.platform.authelia snap.platform.api snap.platform.login snap.platform.nginx-public (→ web UI back)
- then rebooted — it came back clean: drive auto-mounted, all apps + platform services up, https 200
Diagnosis path for others hitting “ERR_CONNECTION_REFUSED + apps not starting”:
- lsblk (is the data disk actually there?)
- systemctl status opt-disk-external.mount
- journalctl -b | grep -i “permission denied” (app crash-loops)
- snap services platform (enabled/active?)
- snap changes (a failed auto-refresh?)
Caveat: mine was a flaky USB cable (the disk has its own PSU, so it wasn’t power). I’ve re-seated it, but a dodgy cable can drop it again. After any drop, run a btrfs scrub + smartctl to confirm the data survived (SMART passed, scrub 0 errors for me — it’s a healthy WD 4TB Red).
This would help me to understand when the auto refresh error happened and why, so I could try to make it more robust
snap change 1960
Got my local AI to help with looking into it, hope it’s not complete slop but I do agree that probably the simplest way to reproduce this error is to have an external drive disconnect before an update and then see what breaks. Here’s what the AI thinks:
Hi Boris — I’m an AI assistant helping Dan troubleshoot this, and he’s asked me to write this up. Thanks for the quick help getting it back up.
On snap change 1960 — sadly we can’t retrieve it anymore. The change record is no longer in snapd’s state:
$ snap change 1960
error: cannot find change with id "1960"
$ snap changes
no changes found
We also checked state.json (it currently holds 0 change records, even though it’s been rewritten since), and the persistent journal has rotated past the 8 Sep window (only ~1 line remains) — so the snapd error text from that moment is gone too. The exact failing task/message from change 1960 can’t be reproduced on our side.
What we can still see on disk — and it supports the theory that the update hit a data-drive dependency and failed:
- platform is now 3120 (
/snap/platform/current -> 3120, created 8 Sep 23:37 — right in change 1960’s 23:03–23:08 window), with the old 3091 still on disk butdisabled. - Both
platform_3091.snapandplatform_3120.snapexist under/var/lib/snapd/snaps/. - The platform’s own state lives on the external data drive:
/data/platform/sits alongside the app dirs. - Anomaly:
/var/lib/snapd/snaps/platform.currentis missing and there’s no/var/lib/snapd/sequence/platform— as if the snapd state DB was reset/rebuilt during the failed base-snap update (which would also explain why the change history is gone).
Our best guess at the sequence: the external data drive dropped (flaky USB cable) → a platform auto-refresh ran anyway → the update progressed until a step that needs /data (or /data/platform) failed → the change was marked Error and the platform services were left disabled (→ ERR_CONNECTION_REFUSED), while the app snaps crash-looped on mkdir /data/...: permission denied. The base-snap failure also appears to have left the snapd state inconsistent and wiped the change records.
How we’d suggest reproducing it (we don’t have a spare box to do it ourselves):
- On a lab Syncloud with data on a separate/USB disk, stop the data mount to simulate the drive being gone —
systemctl stop opt-disk-external.mount(then confirm/datais empty). More deterministic than physically pulling the cable. - Force a platform snap transaction so the update path runs:
snap install platform --revision=<older-rev>thensnap refresh platform, or simplysnap refresh platformwhen a newer rev is available (or letsnap auto-refreshfire with the drive stopped). - Capture at each step:
snap change <id>+snap tasks <id>(which task failed + the exact error),journalctl -fduring the run, andsnap services platformafterward — the key question is whether it ends with the services disabled and whether it auto-rolls back to a working state. - Re-attach the drive (
systemctl start opt-disk-external.mount) and see what, if anything, recovers.
What we’d suggest for the auto-refresh to be more robust (in priority order):
- Pre-flight gate: before a platform/base-snap update, verify the data disk is mounted, healthy, and
/data/platformis present + writable. If not, defer the update with a clear status (“update deferred: data disk unavailable”) instead of proceeding into a broken state. - Guaranteed rollback to a working state: on any failed platform update, restore the previous revision and re-enable + activate the core services. Never leave the base snap with its services disabled — that’s what made the box unreachable.
- Durable change/task records: a failed base-snap update shouldn’t wipe the change history — we wanted
snap change 1960to diagnose this and it was gone. - Stability watchdog: a post-update/post-reboot check that core services are up and
/datais mounted, then repairs and alerts. - Reconsider the coupling: platform-critical state living on the removable data disk means a single flaky cable takes down the whole box and its update path. At minimum, make the update fail early and safely when the drive is absent.
For reference the box is healthy now: all platform services are enabled + active, the web UI returns 200, and snap refresh --list shows no platform refresh currently scheduled.
Happy to capture anything else on our side if it’d help.
Having usb disk is probably not great, what machine do you have, do you want to switch to a proper sata SSD or something?
It’s a intel nuc skull canyon. It has room for 2 m.2 SSDs but they’re pretty expensive at the moment. I’ve got plans to move my server, just gotta be careful in the mean time