Building Wekan Snap failed

xet7 · July 12, 2021, 3:58pm

Hi,
Building Wekan Snap failed. How to fix?

Error:

checksums do not match. Please ensure the snap is created with either 'snapcraft pack ’ (using snapcraft >= 2.38) or ‘mksquashfs -noappend -comp xz -all-root -no-xattrs -no-fragments’ (using squashfs-tools >= 4.3). If using electron-builder, please upgrade to latest stable (>= 20.14.7). See Automated reviews and snapcraft < 2.38 for details. security-snap-v2_squashfs_repack_checksum

Build log:

https://launchpad.net/~build.snapcraft.io/+snap/100453500e32d01a904a5c483a898df3/+build/1463452/+files/buildlog_snap_ubuntu_xenial_amd64_100453500e32d01a904a5c483a898df3_BUILDING.txt.gz

snapcraft.yaml:

github.com

wekan/wekan/blob/master/snapcraft.yaml

name: wekan
version: '5.37'
summary: The open-source kanban
description: |
   Wekan is an open-source and collaborative kanban board application.

   Whether you’re maintaining a personal todo list, planning your holidays with some friends, or working in a team on your next revolutionary idea, Kanban boards are an unbeatable tool to keep your things organized. They give you a visual overview of the current state of your project, and make you productive by allowing you to focus on the few items that matter the most.
   Depending on target environment, some configuration settings might need to be adjusted.
   For full list of configuration options call:
   $ wekan.help

confinement: strict
grade: stable

architectures:
  - amd64

plugs:
  mongodb-plug:
    interface: content

This file has been truncated. show original

xet7 · July 17, 2021, 4:10am

Is building snaps completely broken? I can not even reject any failed builds from review queue.

xet7 · July 17, 2021, 4:11am

And now I also got “Server not found” error.

sergiusens · July 19, 2021, 7:14pm

@alexmurray or @roadmr do you have any thoughts on why the resquash test would fail for this snap? Snapcraft uses snap pack. Could it be related to the kernel on the builders or the test machine where this is run? But also, it only seems to be affecting this snap (anecdotal, I don’t have access to all the uploads and have not seen any other reports here).

xet7 · July 19, 2021, 7:52pm

Snap build servers have built Wekan Snap for many years. Only some days ago I got this new error message, like someone would have added some new specific requirement.

xet7 · July 19, 2021, 7:54pm

I did release Wekan newest version for other platforms like Docker/Source/Sandstorm etc, but all Snap builds failed. About 9000 servers wordwide use Wekan Snap packages and are now without updates. There is often Node.js etc security updates.

ijohnson · July 19, 2021, 8:08pm

Is this effectively building on launchpad?

roadmr · July 19, 2021, 9:04pm

The Snap Store package reviewing servers were updated to Ubuntu 20.04 (Focal) on July 5th. This matches the timing of when your failures started; your last successful wekan build was on 2021-07-05 13:33, the first failed build was on 2021-07-06 19:09, and the servers were updated on 2021-07-05 16:41 (all times are UTC).

I have confirmed that your snap passes automated review on a bionic system with squashfs-tools 4.3-6ubuntu0.18.04.2, and fails on a focal system with 4.4-1.

While we investigate further, one thing you could do is request manual review of revisions you want to publish, and we can likely override the unsquashfs check on our side, assuming the other more security-minded reviewers are fine with that.

Daniel

xet7 · July 20, 2021, 12:40am

@roadmr

Thanks! I requested manual revision of:

wekan 5.38 revision 1602
wekan-ondra 5.38 revision 264
wekan-gantt-gpl 5.38 revision 108

xet7 · July 20, 2021, 1:14am

@roadmr

For a long time, I have tried to convert snapcraft.yaml from https://github.com/wekan/wekan to base20, but I can not get snapcraft.yaml syntax right so that it would build successfully. One of my failing base20 tests is here https://github.com/wekan/wekan-test-alpha/blob/master/snapcraft.yaml .

Wekan itself only needs node binary, mongodb and unarchived .zip file from https://releases.wekan.team to to work. I would like to have multiarch snap with node binary, mongodb and these .zip files:

I have tried to build for at least x64 with this https://github.com/wekan/wekan-snap/blob/master/snapcraft.yaml but build fails.

Build scripts for those .zip files non-x64 archs are here:

They are built and tested directly via ssh access on these donated servers:

But for Caddy, I only have that x64 binary from newest download of old Caddy v1. Other binaries could be built from https://github.com/caddyserver/caddy/tree/v1 , but Caddy has moved to Caddy v2 with not-so-compatible-yet adapter for v1 Caddyfile config format https://caddy.community/t/caddyfile-v1-adapter/9129 , that means some of those 9000 Wekan servers wordwide are still running old unmaintained Caddy v1 with it’s Caddyfile config format. And, if I would try to figure out, is there better Caddy v1 config format adapter now in Caddy, or should I try to contribute it myself as pull request (if it’s not too complex so Caddy devs would accept it), or how I could get it updated. Or alternatively, just only include Caddy v2 and leave configuration with examples to each server admin, but, that’s kind of not-automatic-upgrade, and too much manual work.

xet7 · July 20, 2021, 1:20am

This bundle for x64 https://releases.wekan.team/wekan-latest-x64.zip does also run on:

Windows: https://github.com/wekan/wekan/wiki/Offline
Mac: https://github.com/wekan/wekan/wiki/Mac

But I don’t know would it be possible to run Snap on Windows or Mac.

alexmurray · July 20, 2021, 3:11am

squashfs-tools 4.4. introduced reproducible mksquashfs output by default so I suspect this is the culprit. Perhaps snapcraft and review-tools should both be ported to core20 so they can get squashfs-tools 4.4 as a result? Thoughts @sergiusens?

roadmr · July 20, 2021, 11:25am

@alexmurray @emitorino given that wekan is a known-good build and we’ve traced this down to the squashfs 4.3.x vs. 4.4 difference, are you OK with at least manually approving the revisions @xet7 noted above?

Thanks!

Daniel

sergiusens · July 20, 2021, 12:34pm

It was just pointed out to me that this snap is not using a base, triggering the use of snapcraft from the deb when used with launchpad which is probably using a 16.04 version of mksquashfs.

To answer your question @alexmurray, Snapcraft is moving to core20 for Snapcraft 6.0 (Snapcraft's 21.10 Roadmap), but Snapcraft packs using the snap command from snapd so Snapcraft’s move to core20 should not affect this.

alexmurray · July 20, 2021, 2:44pm

hmm so snap pack will use the mksquashfs from the snapd snap which is from the 16.04 version of squashfs-tools…so I would have thought this would be the same as what LP is using when the deb is used … no?

sergiusens · July 20, 2021, 4:06pm

The deb of snapcraft has been frozen in time to version 2.43.1, https://github.com/snapcore/snapcraft/blob/2.43.1/snapcraft/internal/lifecycle/_packer.py#L74

roadmr · July 21, 2021, 8:04pm

@xet7 Hi there - I’ve been digging into this (lots of fun). I think you could get the build working again if you make post-refresh an actual file instead of a symlink to install (https://github.com/wekan/wekan/tree/master/snap/hooks). Just rm post-refresh && cp install post-refresh should do it. No promises, but maybe worth a try while we get a real fix out.

Daniel

xet7 · July 21, 2021, 10:03pm

@roadmr

Thanks a lot ! With your fix, all those Wekan snap builds worked and are now released !!!

roadmr · July 22, 2021, 3:30pm

A post was merged into an existing topic: Uploads failing “could not mksquashfs ‘squashfs-root’: Parallel mksquashfs”"