How to use spread to test Ubuntu Core image?

orangepi 2017-07-14 10:51:59 UTC #1

I have made a new UbuntuCore Image， now I want to use ｓpread to test it.
The only reference material I know is: https://github.com/snapcore/spread#blacklisting.
Is the any other more informations for how to use spread to test UbuntuCore image.
Thanks!

fgimenez 2017-07-14 12:20:31 UTC #2

Hey @orangepi glad to see you wanting to run spread on Ubuntu Core images! You can use the external backend defined in snapd’s suite, the process is described here https://github.com/snapcore/snapd/blob/master/tests/external-backend.md let us know how it goes.

Cheers

orangepi 2017-07-21 12:22:40 UTC #3

It seem that the spread can’t read the spread.yaml in the snapd project.
What can i do for this error?

fgimenez 2017-07-21 13:09:00 UTC #4

IIRC there were issues wrt to confinement and the tmp dir, could you please retry moving /tmp/snapd to another location outside /tmp?

Thanks,

orangepi 2017-07-21 14:42:09 UTC #5

Thanks! The spread can work correctly when moving the snapd to the $HOME.

orangepi 2017-07-24 08:24:24 UTC #7

I used spread to test UbuntuCore image, the print infomations as below, what may I do for this error?

 2017/07/24 16:14:28 Found /home/xl/snapd/spread.yaml.
 2017/07/24 16:14:30 Project content is packed for delivery (1.23MB).
 2017/07/24 16:14:30 Sequence of jobs produced with -seed=1500884070
 2017/07/24 16:14:30 Allocating external:ubuntu-core-16-arm-32...
 2017/07/24 16:14:30 Waiting for external:ubuntu-core-16-arm-32 to make SSH available at 192.168.1.189:22...
 2017/07/24 16:14:30 Allocated external:ubuntu-core-16-arm-32.
 2017/07/24 16:14:30 Connecting to external:ubuntu-core-16-arm-32...
 2017/07/24 16:14:30 Connected to external:ubuntu-core-16-arm-32 at 192.168.1.189:22.
 2017/07/24 16:14:30 Sending project content to external:ubuntu-core-16-arm-32...
 2017/07/24 16:14:32 Preparing project on external:ubuntu-core-16-arm-32...
 2017/07/24 16:14:55 Preparing external:ubuntu-core-16-arm-32:tests/main/...
 2017/07/24 16:14:56 Error preparing external:ubuntu-core-16-> arm-32:tests/main/ : 

 + . /home/gopath/src/github.com/snapcore/snapd/tests/lib/prepare.sh
 ++ set -eux
 ++ . /home/gopath/src/github.com/snapcore/snapd/tests/lib/apt.sh
 ++ . /home/gopath/src/github.com/snapcore/snapd/tests/lib/snaps.sh
 + [[ ubuntu-core-16-arm-32 == ubuntu-core-16-* ]]
 + prepare_all_snap
 + '[' -e /var/lib/dpkg/status ']'
 + '[' 0 = 1 ']'
 + echo 'Wait for firstboot change to be ready'
 Wait for firstboot change to be ready
 + snap changes
 + grep Done
 1    Done    2017-07-24T08:12:25Z  2017-07-24T08:12:54Z  Initialize system state
 3    Done    2017-07-24T08:14:53Z  2017-07-24T08:15:07Z  Install "test-snapd-snapbuild" snap from "edge" channel
 4    Done    2017-07-24T08:15:07Z  2017-07-24T08:15:11Z  Remove "test-snapd-snapbuild" snap
 5    Done    2017-07-24T08:15:12Z  2017-07-24T08:15:13Z  Change configuration of "core" snap
 + echo 'Ensure fundamental snaps are still present'
 Ensure fundamental snaps are still present
 + . /home/gopath/src/github.com/snapcore/snapd/tests/lib/names.sh
 +++ snap list
 +++ sed -n 's/^\(pc\|pi[23]\|dragonboard\) .*/\1/p'
 ++ gadget_name=
 ++ kernel_name=-kernel
 ++ '[' -kernel = pi3-kernel ']'
 + for name in '$gadget_name' '$kernel_name' core
 + snap list
 + grep -kernel
 grep: invalid option -- 'k'
 Usage: grep [OPTION]... PATTERN [FILE]...
 Try 'grep --help' for more information.
 + echo 'Not all fundamental snaps are available, all-snap image not valid'
 Not all fundamental snaps are available, all-snap image not valid
 + echo 'Currently installed snaps'
 Currently installed snaps
 + snap list
 Name                     Version      Rev   Developer  Notes
 core                     16-2.27      2412  canonical  core
 linux-generic-allwinner  4.11.0-7.12  1     ogra       kernel
 orangepi-zero            16-0.1       1     ogra       gadget
 + exit 1

 2017/07/24 16:14:56 Restoring external:ubuntu-core-16-arm-32:tests/main/...
 2017/07/24 16:14:56 Error restoring external:ubuntu-core-16-arm-32:tests/main/ : 

 + /home/gopath/src/github.com/snapcore/snapd/tests/lib/reset.sh --store
 + [[ ubuntu-core-16-arm-32 == ubuntu-core-16-* ]]
 + reset_all_snap --store
 + . /home/gopath/src/github.com/snapcore/snapd/tests/lib/names.sh
 +++ snap list
 +++ sed -n 's/^\(pc\|pi[23]\|dragonboard\) .*/\1/p'
 ++ gadget_name=
 ++ kernel_name=-kernel
 ++ '[' -kernel = pi3-kernel ']'
 + for snap in '/snap/*'
 + snap=bin
 + case "$snap" in
 + for snap in '/snap/*'
 + snap=core
 + case "$snap" in
 + for snap in '/snap/*'
 + snap=linux-generic-allwinner
 + case "$snap" in
 + snap remove linux-generic-allwinner
 error: cannot remove "linux-generic-allwinner": snap "linux-generic-allwinner"
        is not removable

 2017/07/24 16:14:56 Restoring external:ubuntu-core-16-arm-32:tests/main/...
 2017/07/24 16:14:56 Error restoring external:ubuntu-core-16-arm-32:tests/main/ : 

 + /home/gopath/src/github.com/snapcore/snapd/tests/lib/reset.sh --store
 + [[ ubuntu-core-16-arm-32 == ubuntu-core-16-* ]]
 + reset_all_snap --store
 + . /home/gopath/src/github.com/snapcore/snapd/tests/lib/names.sh
 +++ snap list
 +++ sed -n 's/^\(pc\|pi[23]\|dragonboard\) .*/\1/p'
 ++ gadget_name=
 ++ kernel_name=-kernel
 ++ '[' -kernel = pi3-kernel ']'
 + for snap in '/snap/*'
 + snap=bin
 + case "$snap" in
 + for snap in '/snap/*'
 + snap=core
 + case "$snap" in
 + for snap in '/snap/*'
 + snap=linux-generic-allwinner
 + case "$snap" in
 + snap remove linux-generic-allwinner
 error: cannot remove "linux-generic-allwinner": snap "linux-generic-allwinner"
        is not removable

 2017/07/24 16:14:56 Restoring project on external:ubuntu-core-16-arm-32...
 2017/07/24 16:14:58 Successful tasks: 0
 2017/07/24 16:14:58 Aborted tasks: 117
 2017/07/24 16:14:58 Failed suite prepare: 1
     - external:ubuntu-core-16-arm-32:tests/main/
 2017/07/24 16:14:58 Failed suite restore: 2
     - external:ubuntu-core-16-arm-32:tests/main/
     - external:ubuntu-core-16-arm-32:tests/main/
 2017/07/24 16:14:58 Keeping external:ubuntu-core-16-arm-32 at 192.168.1.189:22
 error: unsuccessful run

ogra 2017-07-24 10:24:30 UTC #8

looks like it should not attempt to try to remove the kernel, you might need to hack https://github.com/snapcore/snapd/blob/master/tests/lib/names.sh to get the mapping between your gadget and the kernel snap for the orangepi …

orangepi 2017-07-26 08:12:50 UTC #9

After modified this file, spread can work correctly.
But there are some failed tasks.

Failed tasks： failover:rclocalcrash resolved

2017/07/26 12:23:55 Executing external:ubuntu-core-16-arm-32:tests/main/failover:rclocalcrash (68/117)...
2017/07/26 12:26:14 Error executing external:ubuntu-core-16-arm-32:tests/main/failover:rclocalcrash : 
-----
+ . /home/gopath/src/github.com/snapcore/snapd/tests/lib/names.sh
++ gadget_name=orangepi-zero-gadget
++ kernel_name=orangepi-zero-kernel
+ . /home/gopath/src/github.com/snapcore/snapd/tests/lib/boot.sh
+ '[' core = kernel ']'
+ TARGET_SNAP_NAME=core
+ '[' 0 = 0 ']'
+ snap list
+ awk '/^core / {print($3)}'
++ cat prevBoot
+ unsquashfs -d /tmp/unpack /var/lib/snapd/snaps/core_2466.snap

Write on output file failed because No space left on device

writer: failed to write data block 49

Failed to write /tmp/unpack/lib/udev/hwdb.bin, skipping
Parallel unsquashfs: Using 4 processors
11926 inodes (12725 blocks) to write

[===========================================================-] 12725/12725 100%

created 9324 files
created 1444 directories
created 2513 symlinks
created 79 devices
created 0 fifos
+ eval inject_rclocalcrash_failure
++ inject_rclocalcrash_failure
++ chmod a+x /tmp/unpack/etc/rc.local
++ cat
+ snapbuild /tmp/unpack .
built: core_16-2.26.14_armhf.snap
+ mv core_16-2.26.14_armhf.snap failing.snap
++ snap install --dangerous failing.snap --no-wait
error: cannot read POST form: write /tmp/multipart-169866813: no space left on
       device
+ chg_id=
-----
2017/07/26 12:26:15 Debug output for external:ubuntu-core-16-arm-32:tests/main/failover:rclocalcrash : 
-----

orangepi 2017-07-26 08:30:06 UTC #10

Failed tasks： listing

2017/07/26 16:18:49 Preparing external:ubuntu-core-16-arm-32:tests/main/listing...
2017/07/26 16:19:27 Executing external:ubuntu-core-16-arm-32:tests/main/listing (32/117)...
2017/07/26 16:19:27 Error executing external:ubuntu-core-16-arm-32:tests/main/listing : 
-----
+ echo 'List prints core snap version'
List prints core snap version
+ '[' external = linode -o external == qemu ']'
+ expected='^core .* [0-9]{2}-[0-9.]+(\+git[0-9]+\.[0-9a-f]+)? +[0-9]+ +canonical +- *$'
+ snap list
+ grep -Pq '^core .* [0-9]{2}-[0-9.]+(\+git[0-9]+\.[0-9a-f]+)? +[0-9]+ +canonical +- *$'
-----
2017/07/26 16:19:28 Debug output for external:ubuntu-core-16-arm-32:tests/main/listing : 
-----
+ echo '# journal messages for snapd'
# journal messages for snapd
+ journalctl -u snapd
-- Logs begin at Wed 2017-07-26 08:26:12 UTC, end at Wed 2017-07-26 08:26:50 UTC. --
Jul 26 08:26:15 localhost.localdomain snapd[11508]: 2017/07/26 08:26:15.826976 cmd.go:134: exe doesn't have snap mount dir prefix: "/usr/lib/snapd/snapd" vs "/snap"
Jul 26 08:26:18 localhost.localdomain snapd[11508]: 2017/07/26 08:26:18.467889 cmd.go:134: exe doesn't have snap mount dir prefix: "/usr/lib/snapd/snapd" vs "/snap"
Jul 26 08:26:19 localhost.localdomain snapd[11508]: 2017/07/26 08:26:19.009048 main.go:78: Exiting on terminated signal.
Jul 26 08:26:19 localhost.localdomain systemd[1]: Stopping Snappy daemon...
Jul 26 08:26:19 localhost.localdomain systemd[1]: Stopped Snappy daemon.
Jul 26 08:26:35 localhost.localdomain systemd[1]: Starting Snappy daemon...
Jul 26 08:26:36 localhost.localdomain snapd[11833]: 2017/07/26 08:26:36.851017 daemon.go:252: started snapd/2.26.14+git279.63c2007~ubuntu16.04.1 (series 16) ubuntu-core/16 (armhf) linux/4.9-orangepi-zero.
Jul 26 08:26:36 localhost.localdomain systemd[1]: Started Snappy daemon.
Jul 26 08:26:48 localhost.localdomain snapd[11833]: 2017/07/26 08:26:48.728411 cmd.go:134: exe doesn't have snap mount dir prefix: "/usr/lib/snapd/snapd" vs "/snap"
+ echo '# apparmor denials '
# apparmor denials 
+ dmesg --ctime
+ grep DENIED
+ true
+ echo '# seccomp denials (kills) '
# seccomp denials (kills) 
+ dmesg --ctime
+ grep type=1326
+ true

orangepi 2017-07-26 08:46:00 UTC #11

Failed tasks: alias resolved

2017/07/26 16:22:19 Executing external:ubuntu-core-16-arm-32:tests/main/alias (37/117)...
2017/07/26 16:27:19 WARNING: external:ubuntu-core-16-arm-32 running late. Current output:
-----
(... 66 lines above ...)
+ MATCH 'ok command 1'
+ echo 'Removing the snap should remove the aliases'
Removing the snap should remove the aliases
+ snap remove aliases
2017-07-26T08:29:46Z ERROR cannot remove snap file "aliases", will retry in 3 mins: [--root / disable snap-aliases-x1.mount] failed with exit status 1: Removed symlink /etc/systemd/system/multi-user.target.wants/snap-aliases-x1.mount.
Failed to execute operation: Connection reset by peer

2017-07-26T08:33:11Z ERROR cannot remove snap file "aliases", will retry in 3 mins: [--root / disable snap-aliases-x1.mount] failed with exit status 1: Failed to execute operation: Connection timed out

[/] Remove snap "aliases" (x1) from the system
-----
2017/07/26 16:32:19 WARNING: external:ubuntu-core-16-arm-32 running late. Current output:
-----
(...)
2017-07-26T08:36:36Z ERROR cannot remove snap file "aliases", will retry in 3 mins: [--root / disable snap-aliases-x1.mount] failed with exit status 1: Failed to execute operation: Failed to activate service 'org.freedesktop.systemd1': timed out

[-] Remove snap "aliases" (x1) from the system
-----
2017/07/26 16:37:18 Error executing external:ubuntu-core-16-arm-32:tests/main/alias : 
-----
+ echo 'Sanity check'
Sanity check
+ aliases.cmd1
+ MATCH 'ok command 1'
+ aliases.cmd2
+ MATCH 'ok command 2'
+ echo 'Create manual aliases'
Create manual aliases
+ snap alias aliases.cmd1 alias1
+ MATCH '.*- aliases.cmd1 as alias1.*'
+ snap alias aliases.cmd2 alias2
Added:
  - aliases.cmd2 as alias2
+ echo 'Test the aliases'
Test the aliases
+ test -h /snap/bin/alias1
+ test -h /snap/bin/alias2
+ alias1
+ MATCH 'ok command 1'
+ alias2
+ MATCH 'ok command 2'
+ echo 'Check listing'
Check listing
+ snap aliases
+ MATCH 'aliases.cmd1 +alias1 +manual'
+ MATCH 'aliases.cmd2 +alias2 +manual'
+ snap aliases
+ echo 'Disable one manual alias'
Disable one manual alias
+ snap unalias alias2
+ MATCH '.*- aliases.cmd2 as alias2.*'
+ echo 'One still works, one is not there'
One still works, one is not there
+ alias1
+ MATCH 'ok command 1'
+ test '!' -e /snap/bin/alias2
+ alias2
+ MATCH 'alias2: command not found'
+ echo 'Check listing again'
Check listing again
+ snap aliases
+ MATCH 'aliases.cmd1 +alias1 +manual'
+ snap aliases
+ MATCH 'aliases.cmd2 +alias2'
error: pattern not found, got:
Command       Alias   Notes
aliases.cmd1  alias1  manual
+ echo 'Disable all aliases'
Disable all aliases
+ snap unalias aliases
+ MATCH '.*- aliases.cmd1 as alias1*'
+ echo 'Alias is gone'
Alias is gone
+ test '!' -e /snap/bin/alias1
+ alias1
+ MATCH 'alias1: command not found'
+ snap aliases
+ MATCH 'aliases.cmd1 +alias1'
error: pattern not found, got:
Command  Alias  Notes
+ echo 'Recreate one'
Recreate one
+ snap alias aliases.cmd1 alias1
Added:
  - aliases.cmd1 as alias1
+ alias1
+ MATCH 'ok command 1'
+ echo 'Removing the snap should remove the aliases'
Removing the snap should remove the aliases
+ snap remove aliases
2017-07-26T08:29:46Z ERROR cannot remove snap file "aliases", will retry in 3 mins: [--root / disable snap-aliases-x1.mount] failed with exit status 1: Removed symlink /etc/systemd/system/multi-user.target.wants/snap-aliases-x1.mount.
Failed to execute operation: Connection reset by peer

2017-07-26T08:33:11Z ERROR cannot remove snap file "aliases", will retry in 3 mins: [--root / disable snap-aliases-x1.mount] failed with exit status 1: Failed to execute operation: Connection timed out

2017-07-26T08:36:36Z ERROR cannot remove snap file "aliases", will retry in 3 mins: [--root / disable snap-aliases-x1.mount] failed with exit status 1: Failed to execute operation: Failed to activate service 'org.freedesktop.systemd1': timed out

2017-07-26T08:40:01Z ERROR cannot remove snap file "aliases", will retry in 3 mins: [--root / disable snap-aliases-x1.mount] failed with exit status 1: Failed to execute operation: Connection timed out

2017-07-26T08:43:27Z ERROR cannot remove snap file "aliases", will retry in 3 mins: [--root / disable snap-aliases-x1.mount] failed with exit status 1: Failed to execute operation: Failed to activate service 'org.freedesktop.systemd1': timed out

[\] Remove snap "aliases" (x1) from the system
<kill-timeout reached>
-----
2017/07/26 16:37:18 Debug output for external:ubuntu-core-16-arm-32:tests/main/alias : 
-----

ogra 2017-07-26 09:24:57 UTC #12

/tmp is a tmpfs on Ubuntu Core, i fear you do not have enough ram to unpack core there … (unless the tests actually change this to be not a tmpfs, in that case check your disk/SD card)

About the other logs below … I have to hand over to @fgimenez …

orangepi 2017-07-26 09:32:08 UTC #13

testopi@localhost:~$ df -h
Filesystem      Size  Used Avail Use% Mounted on
udev            215M     0  215M   0% /dev
tmpfs            50M  5.0M   45M  11% /run
/dev/mmcblk0p2  7.2G  405M  6.4G   6% /writable
/dev/loop0       70M   70M     0 100% /
/dev/loop1       13M   13M     0 100% /lib/modules
tmpfs           250M  4.0K  250M   1% /etc/fstab
tmpfs           250M     0  250M   0% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           250M     0  250M   0% /sys/fs/cgroup
tmpfs           250M     0  250M   0% /var/lib/sudo
tmpfs           250M     0  250M   0% /tmp
tmpfs           250M     0  250M   0% /mnt
tmpfs           250M     0  250M   0% /media
/dev/loop2       70M   70M     0 100% /snap/core/2499
/dev/loop3      256K  256K     0 100% /snap/orangepi-zero-gadget/1
/dev/loop4       13M   13M     0 100% /snap/orangepi-zero-kernel/1
/dev/loop5       70M   70M     0 100% /snap/core/2506
/dev/mmcblk0p1  127M  8.4M  118M   7% /boot/uboot
cgmfs           100K     0  100K   0% /run/cgmanager/fs
tmpfs            50M     0   50M   0% /run/user/1000
testopi@localhost:~$

The space seems big enough.

ogra 2017-07-26 09:36:36 UTC #14

There you go, 250M is likely to small …

orangepi 2017-07-26 09:38:19 UTC #15

How to modify the space?

ogra 2017-07-26 09:46:37 UTC #16

I fear there is no easy way unless you have more ram, by default the system allocates a maximum of 50% of ram for the tmpfses … while you can run:

sudo mount -t tmpfs -o remount,size=600M /tmp

…to actually set a bigger size, this is limeted by the amount of RAM … alternatively change the tests to not use /tmp but a dir on disk (something like /var/tmp would work i guess)

orangepi 2017-07-26 09:49:48 UTC #17

Failed tasks： prepare-image-uboot resolved

2017/07/26 17:34:19 Preparing external:ubuntu-core-16-arm-32:tests/main/prepare-image-uboot...
2017/07/26 17:34:54 Executing external:ubuntu-core-16-arm-32:tests/main/prepare-image-uboot (1/1)...
2017/07/26 17:37:51 Error executing external:ubuntu-core-16-arm-32:tests/main/prepare-image-uboot : 
-----
+ echo Creating model assertion
Creating model assertion
+ cat
+ echo The unverified model assertion will not be copied into the image
The unverified model assertion will not be copied into the image
+ export UBUNTU_IMAGE_SKIP_COPY_UNVERIFIED_MODEL=1
+ UBUNTU_IMAGE_SKIP_COPY_UNVERIFIED_MODEL=1
+ echo Running prepare-image as a user
Running prepare-image as a user
+ su -c 'SNAPPY_USE_STAGING_STORE=0 snap prepare-image --channel edge --extra-snaps snapweb /tmp/root/model.assertion /tmp/root' test
WARNING: Cannot fetch and check prerequisites for the model assertion, it will not be copied into the image making it unusable (unless this is a test): account-key (Jv8_JiHiIzJVcO9M55pPdqSDWUvuhfDIBJUS-3VW7F_idjix7Ffn5qMxB21ZQuij) not found
Fetching core
Fetching pi2-kernel
error: write /tmp/root/image/var/lib/snapd/seed/snaps/pi2-kernel_30.snap.partial: no space left on device
-----
2017/07/26 17:37:52 Debug output for external:ubuntu-core-16-arm-32:tests/main/prepare-image-uboot : 
-----
+ echo '# journal messages for snapd'
# journal messages for snapd
+ journalctl -u snapd
-- Logs begin at Wed 2017-07-26 09:41:39 UTC, end at Wed 2017-07-26 09:45:12 UTC. --
Jul 26 09:41:39 localhost.localdomain systemd[1]: Stopped Snappy daemon.
Jul 26 09:42:11 localhost.localdomain systemd[1]: Starting Snappy daemon...
Jul 26 09:42:14 localhost.localdomain snapd[2428]: 2017/07/26 09:42:14.689777 daemon.go:252: started snapd/2.26.14+git279.63c2007~ubuntu16.04.1 (series 16) ubuntu-core/16 (armhf) linux/4.9-orangepi-zero.
Jul 26 09:42:14 localhost.localdomain systemd[1]: Started Snappy daemon.
+ echo '# apparmor denials '
# apparmor denials 
+ dmesg --ctime
+ grep DENIED
+ true
+ echo '# seccomp denials (kills) '
# seccomp denials (kills) 
+ dmesg --ctime
+ grep type=1326
+ true

fgimenez 2017-07-26 10:10:40 UTC #18

For doing this you could define the TMPDIR env var in an environment block, this one https://github.com/snapcore/snapd/blob/master/spread.yaml#L3 for affecting the whole project, maybe you could also try setting it at the suite or task level instead. Not sure though if all the tools involved will honor it, but worth to give it a try.

orangepi 2017-07-26 10:17:06 UTC #19

After modified https://github.com/snapcore/snapd/blob/master/tests/main/prepare-image-uboot/task.yaml

The prepare-image-uboot can test successfully.

    2017/07/26 17:52:29 Reusing external:ubuntu-core-16-arm-32...
    2017/07/26 17:52:30 Reusing project data on external:ubuntu-core-16-arm-32...
    2017/07/26 17:52:30 Preparing project on external:ubuntu-core-16-arm-32...
    2017/07/26 17:52:32 Preparing external:ubuntu-core-16-arm-32:tests/main/...
    2017/07/26 17:53:53 Preparing external:ubuntu-core-16-arm-32:tests/main/prepare-image-uboot...
    2017/07/26 17:54:31 Executing external:ubuntu-core-16-arm-32:tests/main/prepare-image-uboot (1/1)...
    2017/07/26 17:58:42 Restoring external:ubuntu-core-16-arm-32:tests/main/prepare-image-uboot...
    2017/07/26 17:58:42 Restoring external:ubuntu-core-16-arm-32:tests/main/...
    2017/07/26 17:59:17 Restoring project on external:ubuntu-core-16-arm-32...
    2017/07/26 17:59:21 Successful tasks: 1
    2017/07/26 17:59:21 Aborted tasks: 0

orangepi 2017-07-26 10:56:37 UTC #20

2017/07/26 18:32:01 Preparing external:ubuntu-core-16-arm-32:tests/main/...
2017/07/26 18:32:03 Preparing external:ubuntu-core-16-arm-32:tests/main/failover:rclocalcrash...
2017/07/26 18:32:48 Executing external:ubuntu-core-16-arm-32:tests/main/failover:rclocalcrash (1/2)...
2017/07/26 18:36:25 Rebooting external:ubuntu-core-16-arm-32 as requested...
2017/07/26 18:37:28 Restoring external:ubuntu-core-16-arm-32:tests/main/failover:rclocalcrash...
2017/07/26 18:37:32 Preparing external:ubuntu-core-16-arm-32:tests/main/failover:emptysystemd...
2017/07/26 18:38:12 Executing external:ubuntu-core-16-arm-32:tests/main/failover:emptysystemd (2/2)...
2017/07/26 18:41:47 Rebooting external:ubuntu-core-16-arm-32 as requested...
2017/07/26 18:46:49 Reboot of external:ubuntu-core-16-arm-32 is taking a while...

After failover task, Reboot failed -- System halted

fgimenez 2017-07-26 11:02:58 UTC #21

Regarding the rest of errors:

listing: the output is not helpful, what does snap list give you in an open session?
alias: not sure what happened there, the test snap removal failed, can you retry the test? If you have the complete debug output that would be very helpful.

@cachio could you please take a look at this?

Thanks!