Syncloud + Nextcloud + Update = Broken?

#1

Hi all,

Admittedly, I’m entirely new to Syncloud. I saw it as an alternative to manually trying to manage a server when I want something that is low maintenance.

I’m currently testing it out on a Pi 3 - self installed from images.

I’ve encountered an issue whereby when I’ve got Nextcloud and Plex installed. With the image online 21.01, these both work very well. However, if I check for updates from the Syncloud UI, it shows installed is 210114627, upgrade to 210215644.
If I then do the upgrade, it breaks the Nextcloud snap somehow to the point where it will either

  1. Not start
  2. Run but show a 502 Nginx error
  3. Not installed after being removed

I’m now setting up another server again without upgrading and once everything is set up, I will image the SD to save myself the work again.

Definitely something that could do with being looked into though, why updating Syncloud breaks Nextcloud.

Unfortunately, given the world of Linux etc I’m a bit of a dunce but learn quick, so I am open to suggestions.

#2

Which image exactly you used?
What do you see on Settings - Internal Memory page?

#3

https://github.com/syncloud/platform/releases/download/21.01/syncloud-raspberrypi-21.01.img.xz

That is the exact image I downloaded.

On the Internal Memory page, the Boot Partition says 29.6G

#4

Ok, can you send logs from Settings - Support and check support?
It can be related to corrupt SD card.

#5

Any updates?
Did you send logs?

#6

Hi Boris,

Apologies, been busy of late.

Sent logs just now.

Still running version 210114627 and the system is stable, Plex running well and nextcloud is working despite a weird issue with uploads transferring a 40-50MB at a time with large >1gb file then waiting 10-20 seconds before sending more but that’s a different issue. Its working nonetheless.

I will take an image of the SD card so I’ve got a backup.

I don’t think it’s a corrupt SD card as the card has been used for other PI images without fail and the issue only occurs when updating Syncloud directly from the UI.

#7

There is some kernel sack trace, which actually mentions ext4 filesystem:

[ 9411.874532] [<808cdb04>] (dump_stack) from [<802c7324>] (warn_alloc+0xd4/0x15c)
[ 9411.874546]  r8:80d05684 r7:00000a00 r6:80ab60e4 r5:00000000 r4:80d04f48 r3:b49e1e6e
[ 9411.874562] [<802c7250>] (warn_alloc) from [<802c84f4>] (__alloc_pages_nodemask+0x1090/0x123c)
[ 9411.874570]  r3:00000000 r2:80ab60e4
[ 9411.874578]  r6:00000000 r5:00000000 r4:00000200
[ 9411.874594] [<802c7464>] (__alloc_pages_nodemask) from [<802c8940>] (page_frag_alloc+0x180/0x1a0)
[ 9411.874607]  r10:00000000 r9:00000000 r8:00000000 r7:00000a00 r6:00000a20 r5:00000b40
[ 9411.874613]  r4:b6b2be48
[ 9411.874631] [<802c87c0>] (page_frag_alloc) from [<8077b35c>] (__netdev_alloc_skb+0x150/0x184)
[ 9411.874641]  r7:00000a00 r6:b6b2be48 r5:b5cd1000 r4:00000b40
[ 9411.874657] [<8077b20c>] (__netdev_alloc_skb) from [<80694084>] (rx_submit+0x10c/0x23c)
[ 9411.874667]  r7:00000a00 r6:b6a36780 r5:b264b700 r4:b5cd1540
[ 9411.874679] [<80693f78>] (rx_submit) from [<80694ba4>] (rx_complete+0x200/0x220)
[ 9411.874692]  r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:b6a36780 r5:b264b700
[ 9411.874699]  r4:b5cd1540 r3:00000001
[ 9411.874716] [<806949a4>] (rx_complete) from [<8069ecec>] (__usb_hcd_giveback_urb+0x74/0x118)
[ 9411.874726]  r7:00000000 r6:00000000 r5:b5e10400 r4:b264b700
[ 9411.874741] [<8069ec78>] (__usb_hcd_giveback_urb) from [<8069eddc>] (usb_hcd_giveback_urb+0x4c/0xfc)
[ 9411.874752]  r7:80d04f48 r6:b264b700 r5:b264b700 r4:a6e1a200
[ 9411.874772] [<8069ed90>] (usb_hcd_giveback_urb) from [<806ca854>] (completion_tasklet_func+0x90/0xd0)
[ 9411.874782]  r6:b264b700 r5:b5e38000 r4:a6e1a200 r3:60000113
[ 9411.874798] [<806ca7c4>] (completion_tasklet_func) from [<806d9fec>] (tasklet_callback+0x20/0x24)
[ 9411.874808]  r7:b6b212c4 r6:00000000 r5:b657c984 r4:b657c980
[ 9411.874825] [<806d9fcc>] (tasklet_callback) from [<8012628c>] (tasklet_action_common+0x64/0xec)
[ 9411.874842] [<80126228>] (tasklet_action_common) from [<8012633c>] (tasklet_hi_action+0x28/0x30)
[ 9411.874856]  r9:00000001 r8:b645e000 r7:00000100 r6:b3192000 r5:00000000 r4:80d03080
[ 9411.874873] [<80126314>] (tasklet_hi_action) from [<8010249c>] (__do_softirq+0x1a4/0x418)
[ 9411.874887] [<801022f8>] (__do_softirq) from [<80126130>] (irq_exit+0x100/0x110)
[ 9411.874901]  r10:8575cbc0 r9:b3192000 r8:b645e000 r7:00000001 r6:00000000 r5:00000000
[ 9411.874907]  r4:80ca42e4
[ 9411.874923] [<80126030>] (irq_exit) from [<80181200>] (__handle_domain_irq+0x70/0xc4)
[ 9411.874938] [<80181190>] (__handle_domain_irq) from [<80102228>] (bcm2836_arm_irqchip_handle_irq+0x60/0xa4)
[ 9411.874951]  r8:00000000 r7:b3193a84 r6:ffffffff r5:60000013 r4:00000000 r3:b3193a50
[ 9411.874965] [<801021c8>] (bcm2836_arm_irqchip_handle_irq) from [<80101a3c>] (__irq_svc+0x5c/0x7c)
[ 9411.874974] Exception stack(0xb3193a50 to 0xb3193a98)
[ 9411.874984] 3a40:                                     b3193ac0 a412e000 00000ff4 00000ff4
[ 9411.874997] 3a60: b3193ac0 80d04f48 2bb96f47 afaa3ad0 00000000 00000001 8575cbc0 b3193b84
[ 9411.875008] 3a80: b66d06c0 b3193aa0 803e0850 80526954 60000013 ffffffff
[ 9411.875016]  r4:80526954 r3:b49e1e6e
[ 9411.875033] [<803e07f8>] (ext4_chksum) from [<803e0ca4>] (ext4_dirblock_csum_verify+0x90/0x120)
[ 9411.875042]  r6:8575cbc0 r5:afaa3ad0 r4:24f5febc
[ 9411.875057] [<803e0c14>] (ext4_dirblock_csum_verify) from [<803e3064>] (__ext4_find_entry+0x234/0x580)
[ 9411.875067]  r6:00000001 r5:00000001 r4:00000000 r3:b5d8a800
[ 9411.875081] [<803e2e30>] (__ext4_find_entry) from [<803e3a70>] (ext4_lookup+0xe4/0x2d0)
[ 9411.875096]  r10:00000000 r9:b3193c64 r8:b3193c54 r7:b3193c40 r6:afaa3ad0 r5:b587a4c8
[ 9411.875102]  r4:80d04f48
[ 9411.875119] [<803e398c>] (ext4_lookup) from [<80303714>] (__lookup_slow+0x9c/0x174)
[ 9411.875133]  r10:00000000 r9:b3193dc0 r8:00000009 r7:b587aee0 r6:afaa3ad0 r5:80d04f48
[ 9411.875138]  r4:b587a4c8
[ 9411.875154] [<80303678>] (__lookup_slow) from [<8030382c>] (lookup_slow+0x40/0x54)
[ 9411.875167]  r10:000000c3 r9:b3193eac r8:b3193d3c r7:b3193dc0 r6:00000009 r5:b587aee0
[ 9411.875173]  r4:afaa3b50
[ 9411.875189] [<803037ec>] (lookup_slow) from [<80303a9c>] (walk_component+0x25c/0x690)
[ 9411.875199]  r7:00000000 r6:00000000 r5:80d04f48 r4:b3193db8
[ 9411.875215] [<80303840>] (walk_component) from [<80304484>] (path_lookupat+0x78/0x214)
[ 9411.875228]  r10:000000c3 r9:b3193eac r8:00000041 r7:b3193eac r6:80d04f48 r5:00000000
[ 9411.875234]  r4:b3193db8
[ 9411.875250] [<8030440c>] (path_lookupat) from [<80306ea8>] (filename_lookup+0xac/0x11c)
[ 9411.875262]  r8:00000001 r7:b3193db8 r6:a1726000 r5:80d04f48 r4:00000001
[ 9411.875278] [<80306dfc>] (filename_lookup) from [<80307028>] (user_path_at_empty+0x50/0x58)
[ 9411.875292]  r9:b3193ef0 r8:00000000 r7:745e0540 r6:b3193eac r5:ffffff9c r4:00000001
[ 9411.875307] [<80306fd8>] (user_path_at_empty) from [<802fa4c4>] (vfs_statx+0x7c/0xe8)
[ 9411.875316]  r6:ffffff9c r5:00000800 r4:00000001
[ 9411.875328] [<802fa448>] (vfs_statx) from [<802fad6c>] (__do_sys_stat64+0x40/0x70)
[ 9411.875342]  r10:000000c3 r9:b3192000 r8:801011c4 r7:000000c3 r6:73b0ac50 r5:6fafa358
[ 9411.875347]  r4:80d04f48
[ 9411.875361] [<802fad2c>] (__do_sys_stat64) from [<802fb1c8>] (sys_stat64+0x18/0x1c)
[ 9411.875368]  r5:76f5c9c0 r4:745e0540
[ 9411.875381] [<802fb1b0>] (sys_stat64) from [<80101000>] (ret_fast_syscall+0x0/0x28)
[ 9411.875387] Exception stack(0xb3193fa8 to 0xb3193ff0)
#8

If you decide to upgrade at some point, please send us logs right away if issue appears.
I will try to test on my RPi upgrade from the same version.

#9

I think I know what is happening, do you have an Apple Router or something like this?

#10

No Apple router, but I’ve got an Asus rx82u, well 2 of them on AImesh.

#11

We have released an update to fix some router (natpmp) related issue, could you update when you have time to see if upgrade still breaks things for you?

#12

Thanks, will try it but will need too take it down to do a backup of the SD card first

#13

Still broken I’m afraid. Somewhat frustrating as now my Nextcloud instance is being hijacked by Nginx which I think is the Syncloud snap stealing the port.
Unfortunately, I never got round to taking a backup of the SD.
It would also seem that this broke during the course of an apt update, I was installing CUPS printer driver for a label printer and looks like performing apt update broke nextcloud.

Performing the syncloud update made no difference.

#14

Are you saying this is not stock image + Platform update?
apt update will probably break things.
Syncloud Nextcloud (php fpm) is actually listening on a unix socket file and Syncloud Platform nginx is listening on 443/80.

#15

This is stock image. Installing CUPS installed a load of dependencies which I think broke nextcloud.

Obviously, not being able to install other packages like a print server because it might break something like that is a deal breaker.

Nonetheless, that’s what’s happening, going to the nextcloud page opens an Nginx error, seeing as Syncloud snap runs on Nginx, something is breaking PHP fpm or Nginx is hijacking it.

#16

Why do you install cups on server?
If you really want to use apt to install random things I would suggest to isolate Syncloud and use docker image instead and then deal with exposing port and making sure that cups or any other software is not taking the same ports.