Hey, we are using Ubuntu Frame to show our intercom app(snapped Flutter app) in our intercom panel.
We are looking for a way to automate inputs for testing purposes.
I was looking to have a snap(we can sideload for testing UI snap ) that can send fake input/keyboard events by utilizing zwlr_virtual_pointer_manager_v1 and zwp_virtual_keyboard_manager_v1 protocols, What I saw is ubuntu frame have a limitation on exposing protocols to other snaps.
AuthModel const auth_model{{
{“ubuntu-frame-osk”, {
WaylandExtensions::zwlr_layer_shell_v1,
WaylandExtensions::zwp_virtual_keyboard_manager_v1,
WaylandExtensions::zwp_input_method_manager_v2,
}},
{“ubuntu-frame-vnc”, {
WaylandExtensions::zwlr_screencopy_manager_v1,
WaylandExtensions::zwlr_virtual_pointer_manager_v1,
WaylandExtensions::zwp_virtual_keyboard_manager_v1,
}},
{“ubuntu-frame”, {
WaylandExtensions::zwlr_screencopy_manager_v1,
WaylandExtensions::zwlr_layer_shell_v1,
WaylandExtensions::zwlr_foreign_toplevel_manager_v1
}},
}};
I extended this list with my new snap name and the protocols I need from my testing snap, and I ended up able to automate some UI flows.
Now I am wondering if that is the correct approach to test UI flows. If so, what would be the possibility of having an extendable list of auth_models?
Otherwise, happy to hear your suggestions.
Thank you.