Beta Testing Checklist
Date: June 22, 2021
Device: 3a
Build number: RQ3A.210605.005.2021.06.20.20

Receive incoming calls: Yes
Make outgoing phone calls: Yes
Receive incoming texts: Yes
Send outgoing texts: Yes
Internet connectivity: Yes
Internet browsing: Yes
Vanadium use:

• Video playback: Yes
• Renders websites: Yes
  Media playback: Yes
  PDF Viewer: Not Tested
  Alarms/Timer: Yes
  Cameras (Front and Rear): Yes
  Video: Yes
  Microphones: Yes
  USB Devices & Peripherals: Yes
  File Browsing: Works
  Media Transfer to PC: Not Tested
  Application Installs: Yes
  Switch Between Profiles: Yes
  Log Out Profiles: Yes

Other Notes:
Was not able to test IPv6

Date: May 30th, 2021
Device: Flame (Pixel 4)
Build number: RQ2A.210505.002.2021.05.29.09

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Internet browsing: Works
Vanadium use Works

• Video playback: Works
• Renders websites: Works

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video: Works (The bug in selfie video camera on OpenCamera is preexisting and caused by an upstream issue. A workaround is in place.)
Handset Microphones: Works
Handset Speakers: Works
USB Devices & Peripherals:

• USB Mass Storage: Works
• Keyboards: Not Tested
• USB Digital Audio Output: Works

File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works (The bug in fingerprints being wiped from the enclave when ending session on another profile is not observed on the 4)
Log Out Profiles: Works

Seedvault Backups:

• Owner Profile: Works
• Secondary Profile: Not Tested

Customization: Not Tested

Other Notes:
Everything looks good so far. I didn't find anything broken that wasn't broken before.

Beta Testing Checklist

Device: Sunfish(Pixel 4A)
Build number: RQ2A.210505.002.2021.05.04.01

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works

Internet connectivity: Works
Internet browsing: Works
Vanadium use Works
Video playback: Works
Renders websites: Works

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Working
Alarms/Timer: n/a

Cameras (Front and Rear): Works,

Handset Microphones: Works
Handset Speakers: Works

Keyboards: Works

File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: n/a
Log Out Profiles: n/a
Seedvault Backups: n/a

Device Information

Date: December 20th, 2021
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.211205.017.202122018

Core Functionality

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Internet browsing: Works
Apps Polling/Push (without Play): Works
Location Services: Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use

• Video playback: Works
• Renders websites: Works
• Downloads: Works
• General Browsing: Works

Sound and Devices

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Works
Timer: Works
Cameras (Front and Rear): Works
Video: Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Works
USB Digital Audio Output: Works

Files

File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works

Sandboxed Play Services

Log In to Play Services with U2F on App Store: Works
Unprivileged Installation of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Play Services Fails Gracefully if Network Permission Revoked: Denial of Network permission does not appear to cause Play Services to exhibit excessive battery consumption. Play Store appears to work offline if Network permission is denied.
Google Push Notifications: Not Tested

Seedvault Backups

Owner Profile

Initializing the backup: Not Tested
Taking the backup: Flakey (See attached logcat below. Resolved, currently unable to reproduce but logs have been captured.)
Restoring from backup: Not tested

Secondary Profile

Initializing the backup: Works
Taking the backup: Works
Restoring from backup: Not tested

Owner Profile Test Case:

The first time after the reboot that Seedvault was run, the following error was produced and captured via adb logcat

Workaround: The phone was rebooted and the test case run again. After rebooting, the backup continued normally.

12-20 21:52:17.288 14078 14078 W com.stevesoltys.seedvault: unable to execute idmap2: Permission denied
12-20 21:52:17.288 14078 14078 W OverlayConfig: 'idmap2 create-multiple' failed: no mutable="false" overlays targeting "android" will be loaded
12-20 21:52:17.302 14078 14078 V GraphicsEnvironment: ANGLE Developer option for 'com.stevesoltys.seedvault' set to: 'default'
12-20 21:52:17.302 14078 14078 V GraphicsEnvironment: ANGLE GameManagerService for com.stevesoltys.seedvault: false
12-20 21:52:17.302 14078 14078 V GraphicsEnvironment: Neither updatable production driver nor prerelease driver is supported.
12-20 21:52:17.302 14078 14078 D NetworkSecurityConfig: No Network Security Config specified, using platform default
12-20 21:52:17.302 14078 14078 D NetworkSecurityConfig: No Network Security Config specified, using platform default
12-20 21:52:17.305 14078 14078 D CompatibilityChangeReporter: Compat change id reported: 1531297613045645771; UID 10030; state: DISABLED
12-20 21:52:17.305 14078 14078 D CompatibilityChangeReporter: Compat change id reported: 7528921493777479941; UID 10030; state: DISABLED
12-20 21:52:17.313   580  2784 W libperfmgr: Failed to write to node: /sys/devices/platform/1c500000.mali/power_policy with value: always_on, fd: -1
12-20 21:52:17.316 14078 14108 D mali_cmarp_predictor: checking cmar_predictor for com.stevesoltys.seedvault
12-20 21:52:17.339 12597 13164 W DocumentsProvider: Failed during query
12-20 21:52:17.339 12597 13164 W DocumentsProvider: java.io.FileNotFoundException: No root for 096C-1A15
12-20 21:52:17.339 12597 13164 W DocumentsProvider: 	at com.android.externalstorage.ExternalStorageProvider.getRootFromDocId(ExternalStorageProvider.java:447)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: 	at com.android.externalstorage.ExternalStorageProvider.getFileForDocId(ExternalStorageProvider.java:411)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: 	at com.android.externalstorage.ExternalStorageProvider.getFileForDocId(ExternalStorageProvider.java:406)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: 	at com.android.internal.content.FileSystemProvider.getFileForDocId(FileSystemProvider.java:684)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: 	at com.android.internal.content.FileSystemProvider.includeFile(FileSystemProvider.java:598)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: 	at com.android.internal.content.FileSystemProvider.queryDocument(FileSystemProvider.java:371)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: 	at android.provider.DocumentsProvider.query(DocumentsProvider.java:924)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: 	at android.content.ContentProvider$Transport.query(ContentProvider.java:272)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: 	at android.content.ContentProviderNative.onTransact(ContentProviderNative.java:107)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: 	at android.os.Binder.execTransactInternal(Binder.java:1179)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: 	at android.os.Binder.execTransact(Binder.java:1143)
12-20 21:52:17.339 14078 14120 W DocumentFile: Failed query: java.lang.NullPointerException: Attempt to invoke interface method 'boolean android.database.Cursor.moveToFirst()' on a null object reference
12-20 21:52:17.370 14078 14078 D AndroidRuntime: Shutting down VM
--------- beginning of crash
12-20 21:52:17.370 14078 14078 E AndroidRuntime: FATAL EXCEPTION: main
12-20 21:52:17.370 14078 14078 E AndroidRuntime: Process: com.stevesoltys.seedvault, PID: 14078
12-20 21:52:17.370 14078 14078 E AndroidRuntime: java.lang.RuntimeException: Unable to start service com.stevesoltys.seedvault.storage.StorageBackupService@68b9cfa with null: java.lang.NullPointerException: Parameter specified as non-null is null: method kotlin.jvm.internal.Intrinsics.checkNotNullParameter, parameter intent
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at android.app.ActivityThread.handleServiceArgs(ActivityThread.java:4659)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at android.app.ActivityThread.access$2000(ActivityThread.java:248)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at android.app.ActivityThread$H.handleMessage(ActivityThread.java:2092)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at android.os.Handler.dispatchMessage(Handler.java:106)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at android.os.Looper.loopOnce(Looper.java:201)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at android.os.Looper.loop(Looper.java:288)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at android.app.ActivityThread.main(ActivityThread.java:7841)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at java.lang.reflect.Method.invoke(Native Method)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:548)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at com.android.internal.os.ExecInit.main(ExecInit.java:48)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at com.android.internal.os.RuntimeInit.nativeFinishInit(Native Method)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at com.android.internal.os.RuntimeInit.main(RuntimeInit.java:355)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: Caused by: java.lang.NullPointerException: Parameter specified as non-null is null: method kotlin.jvm.internal.Intrinsics.checkNotNullParameter, parameter intent
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at org.calyxos.backup.storage.backup.BackupService.onStartCommand(Unknown Source:2)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at android.app.ActivityThread.handleServiceArgs(ActivityThread.java:4641)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	... 11 more
12-20 21:52:17.370 14078 14078 E AndroidRuntime: Error reporting crash
12-20 21:52:17.370 14078 14078 E AndroidRuntime: java.lang.RuntimeException: Bad file descriptor
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at android.os.BinderProxy.transactNative(Native Method)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at android.os.BinderProxy.transact(BinderProxy.java:571)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at android.app.IActivityManager$Stub$Proxy.handleApplicationCrash(IActivityManager.java:5294)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at com.android.internal.os.RuntimeInit$KillApplicationHandler.uncaughtException(RuntimeInit.java:156)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at java.lang.ThreadGroup.uncaughtException(ThreadGroup.java:1073)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at java.lang.ThreadGroup.uncaughtException(ThreadGroup.java:1068)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: 	at java.lang.Thread.dispatchUncaughtException(Thread.java:2200)
12-20 21:52:17.370 14078 14078 I Process : Sending signal. PID: 14078 SIG: 9
12-20 21:52:17.388  1488  9334 I ActivityManager: Process com.stevesoltys.seedvault (pid 14078) has died: fg  TOP 
12-20 21:52:17.389   754   754 I Zygote  : Process 14078 exited due to signal 9 (Killed)
12-20 21:52:17.389  1488  1596 I libprocessgroup: Successfully killed process cgroup uid 10030 pid 14078 in 0ms
12-20 21:52:17.389  1488  6332 I WindowManager: WIN DEATH: Window{1b946ea u0 com.stevesoltys.seedvault/com.stevesoltys.seedvault.settings.SettingsActivity}
12-20 21:52:17.389  1488  6332 W InputManager-JNI: Input channel object '1b946ea com.stevesoltys.seedvault/com.stevesoltys.seedvault.settings.SettingsActivity (client)' was disposed without first being removed with the input manager!
12-20 21:52:17.394  1488  9334 W ActivityManager: Scheduling restart of crashed service com.stevesoltys.seedvault/.storage.StorageBackupService in 67108864000ms for start-requested
12-20 21:52:17.395  1488  9334 W ActivityTaskManager: Force removing ActivityRecord{2aa9871 u0 com.stevesoltys.seedvault/.settings.SettingsActivity t463}: app died, no saved state
12-20 21:52:17.396   580  2784 W libperfmgr: Failed to write to node: /sys/devices/platform/1c500000.mali/power_policy with value: always_on, fd: -1
12-20 21:52:17.409   580  2784 W libperfmgr: Failed to write to node: /sys/devices/platform/1c500000.mali/power_policy with value: always_on, fd: -1
12-20 21:52:17.413  1488  1586 W ActivityManager: setHasOverlayUi called on unknown pid: 14078
12-20 21:52:17.414  1488  9334 I SystemUpdateManagerService: No existing info file /data/system/system-update-info.xml
12-20 21:52:17.414  2284  2284 D SysUpdatePrefContr: Update statue unknown
12-20 21:52:17.414  2284  2284 D AssistGesture: mAssistOnly:false, isSupported:false, isSensorAvailable:false
12-20 21:52:17.417  2284  5641 D SettingsActivity: No enabled state changed, skipping updateCategory call

Other Notes

Looks great, seems to be working.

Device Information

Date: March 11th, 2022
Device: Raven (Pixel 6 Pro)
Build number: S2B3.220205.007.A1.2022031103

Core Functionality

Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use

• Internet browsing: Works
• Video playback: Works
• Renders websites: Works
• Downloads: Works
• General Browsing: Works
• Location In Browser (Without Play Services): Works

Networking

Mobile Network

Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
5G Connectivity: Not supported by carrier, 4G and 3G only.
IPv6: Not supported by carrier

Wi-Fi

Wi-Fi connectivity: Works
Wi-Fi calling: Not Tested
IPv6: Works

Sound and Devices

Media playback: Works
Bluetooth Audio Pairing: Not Tested
Bluetooth Audio Playback: Not Tested
Bluetooth Audio Calling: Not Tested
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Not Tested
USB Digital Audio Output: Not Tested
USB Digital Audio Input: Not Tested

Files

File Browsing: Works
Media Transfer to PC: Works

Profiles

Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works

Sandboxed Play Services

Log In & Activate Play Services: Works.
Unprivileged Installation of Apps via Play Store: Works
Unprivileged Update of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested
"Sandboxed Play Services is Running" Notification: Works

Seedvault Backups

Owner Profile

Initializing the backup: Not Tested
Taking the backup: Works, but Seedvault reports a backup not taken successfully error.
Restoring from backup: Not Tested

Secondary Profile

Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested

Other Notes

Nothing broken so far. U2F via Sandboxed Play Services has not been tested, but was found to work with Play Services login.

Device Information

Date: January 7th, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.211205.017.2022010500

Core Functionality

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use

• Internet browsing: Works
• Video playback: Works
• Renders websites: Works
• Downloads: Works
• General Browsing: Works

Sound and Devices

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video: Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Not Tested
USB Digital Audio Output: Works
USB Digital Audio Input: Works

Files

File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works

Sandboxed Play Services

Log In to Play Services with U2F on App Store: Not Tested
Browsers Capable of using Sandboxed Play Services U2F: Firefox for Android, Microsoft Edge for Android
Unprivileged Installation of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested

Seedvault Backups

Owner Profile

Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not tested

Secondary Profile

Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not tested

Other Notes

Nothing seems to be broken. All is well.

Beta Testing Checklist

Date: March 3rd, 2021
Device: Flame (Pixel 4)
Build number: RQ1A.210205.004.2021.03.02.10

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use

• Video playback: Works
• Renders websites: Works

Media playback: Works
PDF Viewer: Works
Alarms/Timer: In Progress
Cameras (Front and Rear): Works
Video: Works
Microphones: Works
USB Devices & Peripherals: In Progress
File Browsing: In Progress
Media Transfer to PC: In Progress
Application Installs: In Progress
Switch Between Profiles: In Progress
Log Out Profiles: In Progress
Seedvault Backups: In Progress

Other Notes:
All in progress, will finish testing soon.

Beta Testing Checklist
Date: April 17, 2021
Device: 3a
Build number: RQ2A.210405.005.2021.04.16.04

Recieve incoming calls: Works
Make outgoing phone calls: Yes
Recieve incoming texts: Yes
Send outgoing texts: Yes
Internet connectivity: Yes
Internet browsing: Yes
Vanadium use:

• Video playback: Yes
• Renders websites: Yes
  Media playback: Yes
  PDF Viewer: Not Tested
  Alarms/Timer: Yes
  Cameras (Front and Rear): Yes
  Video: Yes
  Microphones: Yes
  USB Devices & Peripherals: Yes
  File Browsing: Yes
  Media Transfer to PC: Not Tested
  Application Installs: Yes
  Switch Between Profiles: Yes
  Log Out Profiles: Yes

Other Notes:
Phone working as expected.

Device Information

Date: December 15th, 2021
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.211205.017.2021121421

Core Functionality

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Internet browsing: Works
Location Services: Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use

• Video playback: Works
• Renders websites: Works
• Downloads: Works
• General Browsing: Works

Sound and Devices

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video: Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Not Tested
USB Digital Audio Output: Works

Files

File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works

Sandboxed Play Services

Sandboxed Play Services: Not Tested
Google Camera App: Not Tested
Push Notifications: Not Tested
Banking Apps (Not requiring safety net): Not Tested

Seedvault Backups

Anything in this section is upstream!
Owner Profile: Works (See Below)
Secondary Profile: Not tested

• Upstream Issue: When taking a backup with "Backup Files" selected to a USB Drive, Seedvault will report that a backup has failed in the notifications bar, but when investigated in the "Backup Status" window, reports a successful backup. It will indicate that Seedvault is backing up files, but then stop at 100% and hang, and the notification bubble will not disappear until the phone has been rebooted. This issue may be for upstream.
• Upstream Issue: If files are selected to be included in the backup, this causes the backup to be incomplete, and prevent it from being restored on the destination device. A backup was taken from a Pixel 4 and restored to a Pixel 6. Although the word lists were double-checked and triple checked, the backup could not be restored, with the device returning an error about either the seed being incorrect or the backup not being found. When file backup was switched off and a new backup taken, the backup completed successfully and was successfully restored on the new device. One file that was particularly troublesome for the USB drive to accomodate was a large ~6GB file containing uncompressible data which was selected for backup, and could not be copied off the phone using. Conclusions: File restoration in SeedVault is not fully stable at the time of writing.

Changes to the permission model

Testing Signal 5.27.13 when Network Permission was revoked produced the desired effect of the app continuing to function offline, rather than crash when Network Permission was denied. The app functioned normally once Network Permission was restored. Conclusions: The changes to the new Network Permission model are working as they are intended.

Other Notes

Everything seems to be in good working order.

I did not test Sandboxed Play Services this time due to some time constraints.

Device Information

Date: January 15th, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.211205.007.2022011423

Core Functionality

Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use

• Internet browsing: Works
• Video playback: Works
• Renders websites: Works
• Downloads: Not Tested
• General Browsing: Works

Networking

Mobile Network

Receive incoming calls (Mobile):
Make outgoing phone calls (Mobile):
Receive incoming SMS: Yes
Send outgoing SMS: Yes
Receive incoming MMS: Yes
Send outgoing MMS: Yes
Data connectivity: Yes
5G Connectivity: Not supported by carrier
IPv6: Not supported by carrier

Wi-Fi

Wi-Fi connectivity: Works
Wi-Fi calling: Listed as supported by Freedom Mobile (link) Test results are unchanged from this test in #31 (comment) originally reported January 10th, 2022.
IPv6: Works

Sound and Devices

Media playback: Works
Bluetooth Audio Pairing: Not Tested
Bluetooth Audio Playback: Not Tested
Bluetooth Audio Calling: Not Tested
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Works (Unable to reproduce previous issue)
USB Digital Audio Output: Works
USB Digital Audio Input: Works

Files

File Browsing: Works
Media Transfer to PC: Not Tested

Profiles

Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works

Sandboxed Play Services

Browsers capable of using Sandboxed Play Services U2F: Not Tested
Browsers not capable of using Sandboxed Play Services U2F: Not Tested
Unprivileged Installation of Apps via Play Store: Not Tested
Banking Apps (not requiring Safetynet Check): Not Tested
Google Push Notifications: Not Tested

Seedvault Backups

Owner Profile

Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not tested

Secondary Profile

Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested

Other Notes

No new breakages reported so far.

Device Information

Date: March 2nd, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.220205.003.2022022818

Core Functionality

Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use

• Internet browsing: Works
• Video playback: Works
• Renders websites: Works
• Downloads: Works
• General Browsing: Works
• Location In Browser (Without Play Services): Works

Networking

Mobile Network

Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
5G Connectivity: Not supported by carrier, 4G and 3G only.
IPv6: Not supported by carrier

Wi-Fi

Wi-Fi connectivity: Works
Wi-Fi calling: Not Tested
IPv6: Works

Sound and Devices

Media playback: Works
Bluetooth Audio Pairing: Not Tested
Bluetooth Audio Playback: Not Tested
Bluetooth Audio Calling: Not Tested
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Not Tested
USB Digital Audio Output: Not Tested
USB Digital Audio Input: Not Tested

Files

File Browsing: Works
Media Transfer to PC: Works

Profiles

Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works

Sandboxed Play Services

Log In & Activate Play Services: Works, previous issue has been solved.
Browsers capable of using Sandboxed Play Services U2F: BROKEN - Play Services requests permission to storage, even when permission for Files and media is granted. However, U2F works to log in to Play Services. Microsoft Edge for Android crashes when requesting U2F, Firefox encounters an error where it complains that Play Services needs permission to storage. Further investigation pending.
Browsers not capable of using Sandboxed Play Services U2F: Not Tested
Unprivileged Installation of Apps via Play Store: Works
Unprivileged Update of Apps via Play Store: Not Tested
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested
"Sandboxed Play Services is Running" Notification: Works

Seedvault Backups

Owner Profile

Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not Tested

Secondary Profile

Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not tested

Other Notes

Nothing broken so far. The previous issue with Play Services freezing with a SecurityException Error when authenticating to Play Services has been fixed.

The "Apps" app is working as expected.

Some apps reliant on Play Services for U2F that previously worked before are currently broken. I will investigate further on this.

Device Information

Date: March 24th, 2022
Device: Raven (Pixel 6 Pro)
Build number: SP2A.220305.013.A3.2022032110

Core Functionality

Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use

• Internet browsing: Works
• Video playback: Works
• Renders websites: Works
• Downloads: Works
• General Browsing: Works
• Location In Browser (Without Play Services): Works

Networking

Mobile Network

Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
5G Connectivity: Not supported by carrier, 4G and 3G only.
IPv6: Not supported by carrier

Wi-Fi

Wi-Fi connectivity: Works
Wi-Fi calling: Not Tested
IPv6: Works

Sound and Devices

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Not Tested
PDF Viewer: Works
Alarms: Works
Timer: Works
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Not Tested
USB Keyboards: Not Tested
USB Digital Audio Output: Not Tested
USB Digital Audio Input: Not Tested

Files

File Browsing: Works
Media Transfer to PC: Works

Profiles

Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Not Tested
Auditor Remote Attestation: Works

Sandboxed Play Services

Log In & Activate Play Services: Works
Unprivileged Installation of Apps via Play Store: Works
Unprivileged Update of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested
"Sandboxed Play Services is Running" Notification: Works

Seedvault Backups

Owner Profile

Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not Tested

Secondary Profile

Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested

Other Notes

Nothing broken.

Beta Testing Checklist
Date: May 17, 2021
Device: 3a
Build number: RQ2A.210505.002.2021.05.16.04

Receive incoming calls: Yes
Make outgoing phone calls: Yes
Receive incoming texts: Yes
Send outgoing texts: Yes
Internet connectivity: Yes
Internet browsing: Yes
Vanadium use:

• Video playback: Yes
• Renders websites: Yes
  Media playback: Yes
  PDF Viewer: Not Tested
  Alarms/Timer: Yes
  Cameras (Front and Rear): Yes
  Video: Yes
  Microphones: Yes
  USB Devices & Peripherals: Yes
  File Browsing: Works
  Media Transfer to PC: Not Tested
  Application Installs: Not Tested
  Switch Between Profiles: Yes
  Log Out Profiles: Yes

Other Notes:
Aurora temp down, could not test app install.

Device: bramble (Pixel 4a 5G)
Build number: RQ2A.210505.003.2021.05.16.04

Receive incoming calls: Works (VoLTE, Legacy, and VoWiFi)
Make outgoing phone calls: Works (VoLTE, Legacy, and VoWiFi)
Receive incoming texts: Works
Send outgoing texts: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use:

Video playback: Works (YouTube, Dailymotion, Viprow)

Renders websites: Works (YouTube, Dailymotion, Viprow, duckduckgo, amazon, https://wiki.codeaurora.org/xwiki/bin/QAEP/release)

Media playback: Works (avi/mkv/aac/flac)
PDF Viewer: Works (3 documents)
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
NFC: Works
Alarms: Works
Timer: Works
Cameras (Front and Rear): Works
Video: Works
Handset Microphones: Works
Handset Speakers: Works
USB Devices & DACs: Works
USB Mass Storage: Works
Keyboards: Partial Working (known USB Keyboard crash bug still applies)

File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works

Owner Profile Seedvault Backups: Works
Owner Profile Seedvault Restore: Works

Secondary User Profile Seedvault Backups: Works
Secondary User Profile Seedvault Restore: Works

RQ1A.210205.004.2021.02.23.15 Beta Test Results

Date: February 24th, 2021
Device: Flame (Pixel 4)
Build Number: RQ1A.210205.004.2021.02.23.15

Items Tested

USB Audio Playback with Digital USB-C to 1/8" Adapter: Working
USB Audio Recording with Digital USB-C to 1/8" Adapter: Not Tested
USB Audio Output with USB-C Headset: Working
USB Audio Recording with USB-C Headset Microphone: Working
Onboard Audio Playback: Working
Onboard Audio Recording: Working
Bluetooth Audio Playback: Working
Bluetooth Audio Recording Working
Still Camera on Back Side: Not Tested
Still Camera on Screen Side: Not Tested
Video Camera on Back Side: Not Tested
Video Camera on Screen Side: Not Tested
Switching Between Cameras: Not Tested

If you're on a Pixel 3, 3a, 3XL, or 3aXL, please test the cameras for this update.

Device Information

Date: October 21th 2021
Device: Flame (Pixel 4)
Build number: SP1A.210812.015.2021102020

Core Functionality

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Internet browsing: Works
Vanadium use

• Video playback: Works
• Renders websites: Works

Sound and Devices

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works, tested with GrapheneOS Camera 1.0
Video: Works, tested with GrapheneOS Camera 1.0
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Works
USB Digital Audio Output: Works

Files

File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works

Sandboxed Play Services

Sandboxed Play Services: Works
Google Camera App: Works
Push Notifications: Not Tested

Seedvault Backups

• Owner Profile: Works
• Secondary Profile: Not Tested

Miscellaneous

Customization: Works. The Highlight Colours option seems to have been depreciated.

Other Notes:
Thank you for Android 12.

Everything seems to be in good working order.

Device Information

Date: February 8th, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.220205.003.2022020800

Core Functionality

Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use

• Internet browsing: Works
• Video playback: Works
• Renders websites: Works
• Downloads: Works
• General Browsing: Works

Networking

Mobile Network

Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works, sending group MMS to multiple recipients was performed successfully.
Data connectivity: Works
5G Connectivity: Not supported by carrier, 4G and 3G only.
IPv6: Not supported by carrier

Wi-Fi

Wi-Fi connectivity: Works
Wi-Fi calling: As per existing: #31 (comment)
IPv6: Works

Sound and Devices

Media playback: Works
Bluetooth Audio Pairing: Not Tested
Bluetooth Audio Playback: Not Tested
Bluetooth Audio Calling: Not Tested
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Not Tested
USB Digital Audio Output: Not Tested
USB Digital Audio Input: Not Tested

Files

File Browsing: Works
Media Transfer to PC: Works

Profiles

Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works

Sandboxed Play Services

Browsers capable of using Sandboxed Play Services U2F: Not Tested
Browsers not capable of using Sandboxed Play Services U2F: Not Tested
Unprivileged Installation of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested
Unprivileged Installation of Apps via Play Store: Works
"Sandboxed Play Services is Running" Notification: Works

Seedvault Backups

Owner Profile

Initializing the backup: Not Tested
Taking the backup: Works, but backup is reported as having failed due to unknown reasons. Will test more extensively later.
Restoring from backup: Not tested

Secondary Profile

Initializing the backup: Not Tested
Taking the backup: Works.
Restoring from backup: Not tested

New Features

GrapheneOS App Store: Works, with one problem as below
New App Icons: Displays fine.

Other Notes

PDF Viewer demands being reinstalled via the "Apps" app, stating that the latest version is 8 even though 9 is currently installed.

Beta Testing Checklist

Device: Bonita(Pixel 3a XL)
Build number: RQ3A.210605.005.2021.06.08.06

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works

Internet connectivity: Works
Internet browsing: Works
Vanadium use Works
Video playback: Works
Renders websites: Works

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: n/a
PDF Viewer: Works
Alarms/Timer: Works

Cameras (Front and Rear): Works

Handset Microphones: Works
Handset Speakers: Works

Keyboards: Works

File Browsing: Works
Media Transfer to PC: n/a
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Seedvault Backups: n/a

I recorded my previous test in error, so I am repeating it for thoroughness.

The previous test result was here: #31

To expedite the test, some test cases were skipped.

Device Information

Date: January 11th, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.211205.017.2022011009

Core Functionality

Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use

• Internet browsing: Works
• Video playback: Works
• Renders websites: Works
• Downloads: Works
• General Browsing: Works

Networking

Mobile Network

Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
5G Connectivity: Not supported by carrier, 4G and 3G only.
IPv6: Not supported by carrier

Wi-Fi

Wi-Fi connectivity: Works
Wi-Fi calling: Listed as supported by Freedom Mobile (link) Test results are unchanged from this test in #31 (comment)
IPv6: Works

Sound and Devices

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Not Tested
Bluetooth Audio Calling: Not Tested
PDF Viewer: Not Tested
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Not Tested
USB Keyboards: Not Tested
USB Digital Audio Output: Not Tested
USB Digital Audio Input: Not Tested

Files

File Browsing: Works
Media Transfer to PC: Not Tested

Profiles

Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works

Sandboxed Play Services

Browsers capable of using Sandboxed Play Services U2F: Not Tested
Browsers not capable of using Sandboxed Play Services U2F: Not Tested
Unprivileged Installation of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested

Seedvault Backups

Owner Profile

Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested

Secondary Profile

Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested

Other Notes

I'm starting this off as a way for us to centralize and make it easier to call back on Beta Reports.

For reminders, please join the IRC channel #grapheneos-beta on freenode.

Beta Testing Checklist

Date: February 20th, 2021
Device: Flame (Pixel 4)
Build number: RQ1A.210205.004.2021.02.19.15

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use

• Video playback: Works
• Renders websites: Works

Media playback: Works
PDF Viewer: Works
Alarms/Timer: Works
Cameras (Front and Rear): Works
Video: Works
Microphones: Works
USB Devices & Peripherals: Works
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Seedvault Backups: Works

Other Notes:
No breakages noticed so far.

Beta Testing Checklist

Date: March 31st, 2021
Device: Flame (Pixel 4)
Build number: RQ2A.210305.006.2021.03.30.02

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use Works

• Video playback: Works
• Renders websites: Works

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Working
Alarms/Timer: Not Tested
Cameras (Front and Rear): Works
Video: Works (The bug in selfie video camera on OpenCamera is preexisting and caused by an upstream issue. A workaround is in place.)
Handset Microphones: Works
Handset Speakers: Works
USB Devices & Peripherals:

• USB Mass Storage: Not Tested
• Keyboards: Not Tested
• USB Digital Audio Output: Works

File Browsing: Works
Media Transfer to PC: Works
Application Installs: Not Tested
Switch Between Profiles: Works
Log Out Profiles: Works
Seedvault Backups: Works

Other Notes:
Everything looks good.

Device Information

Date: December 19th, 2021
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.211205.017.202121921

Core Functionality

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Internet browsing: Works
Location Services: Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use

• Video playback: Works
• Renders websites: Works
• Downloads: Works
• General Browsing: Works

Sound and Devices

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video: Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Works
USB Digital Audio Output: Works

Files

File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works

Sandboxed Play Services

U2F via both NFC and USB to log into Play Store from the Play Store App with an account with Advanced Protection Plan enabled appears to be broken.

Seedvault Backups

Owner Profile: Works
Secondary Profile: Works

Both backing up and restoring from an existing profile, as well as provisioning a new backup in a profile that had never had backups set were tested and verified to be working. File backup and restoration was tested and verified to be working.

Other Notes

Everything seems to be in good working order.

Date: 21 July 2021
Device: Bonito (Pixel 3a XL)
Build number: RQ3A.210705.001.2021.07.19.18

Receive incoming calls: Working
Make outgoing phone calls: Working
Receive incoming SMS: Working
Send outgoing SMS: Working
Receive incoming MMS: Not tested
Send outgoing MMS: Not tested
Data connectivity: Working
Wi-Fi connectivity: Working
Internet browsing: Working
Vanadium use

• Video playback: Working
• Renders websites: Working

Media playback: Working
Bluetooth Audio Pairing: Not tested
Bluetooth Audio Playback: Not tested
Bluetooth Audio Calling: Not tested
PDF Viewer: Working
Alarms: Working
Timer: Working
Cameras (Front and Rear): Both working
Video: Working
Handset Microphones: Working
Handset Speakers: Working
USB Devices & Peripherals:

• USB Mass Storage: Working
• Keyboards: Not tested
• USB Digital Audio Output: Not tested

File Browsing: Working
Media Transfer to PC: Working
Application Installs: Working, able to update app via Aurora Store
Switch Between Profiles: Working
Log Out Profiles: Working
Seedvault Backups:

• Owner Profile: Backed up but not restored
• Secondary Profile: Not tested

Customization:

Other Notes:
When phone was rebooted after update I was not prompted for my SIM card unlock PIN. Wi-Fi doesn't turn on but silently fails (no error). Phone calls don't work and prompt message 'mobile network not available'. Mobile data can't be turned on and has message 'no SIM card'. Removing and inserting SIM card again doesn't fix. Tested on primary (owner) profile.

EDIT: Addressed in https://app.element.io/#/room/#testing:grapheneos.org 'it was found to be a bad build due to bad linux USB drivers' - June V. Sideload https://releases.grapheneos.org/bonito-ota_update-2021.07.19.18.zip

EDIT 2: Updated checklist.

Beta Testing Checklist

Date: March 7th, 2021
Device: Flame (Pixel 4)
Build number: RQ2A.210305.006.2021.03.06.00

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use Works

• Video playback: Works
• Renders websites: Works

Media playback: Works
PDF Viewer: Works
Alarms/Timer: In Progress
Cameras (Front and Rear): Works
Video: Works
Microphones: Works
USB Devices & Peripherals:
File Browsing:
Media Transfer to PC:
Application Installs: Works
Switch Between Profiles:
Log Out Profiles:
Seedvault Backups:

Other Notes:
All in progress, will finish testing soon.

Device Information

Date: October 7th 2021
Device: Flame (Pixel 4)
Build number: RQ3A.211001.001.2021100606

Core Functionality

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Internet browsing: Works
Vanadium use

• Video playback: Works
• Renders websites: Works

Sound and Devices

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video: Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Works
USB Digital Audio Output: Works

Files

File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works

Sandboxed Play Services

Sandboxed Play Services
Banking App: Works
Google Camera App: Works
Push Notifications: Not tested

Seedvault Backups

• Owner Profile: Works
• Secondary Profile: Not Tested

Miscellaneous

Customization: Works.

Other Notes:
No breakages or broken features observed.

Device Information

Date: January 31st, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.220105.007.2022013120

Core Functionality

Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use

• Internet browsing: Works
• Video playback: Works
• Renders websites: Works
• Downloads: Works
• General Browsing: Works

Networking

Mobile Network

Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works, sending group MMS to multiple recipients was performed successfully.
Data connectivity: Works
5G Connectivity: Not supported by carrier, 4G and 3G only.
IPv6: Not supported by carrier

Wi-Fi

Wi-Fi connectivity: Works
Wi-Fi calling: As per existing: #31 (comment)
IPv6: Works

Sound and Devices

Media playback: Works
Bluetooth Audio Pairing: Not Tested
Bluetooth Audio Playback: Not Tested
Bluetooth Audio Calling: Not Tested
PDF Viewer: Works
Alarms: Not Tested
Timer: Works
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Not Tested
USB Keyboards: Not Tested
USB Digital Audio Output: Not Tested
USB Digital Audio Input: Not Tested

Files

File Browsing: Works
Media Transfer to PC: Not Tested

Profiles

Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works

Sandboxed Play Services

Browsers capable of using Sandboxed Play Services U2F: Not Tested
Browsers not capable of using Sandboxed Play Services U2F: Not Tested
Unprivileged Installation of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested
Unprivileged Installation of Apps via Play Store: Works
"Sandboxed Play Services is Running" Notification: Works

Seedvault Backups

Owner Profile

Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested

Secondary Profile

Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested

Other Notes

Nothing seems to be broken.

Beta Testing Checklist

Device: Sunfish(Pixel 4A)
Build number: RQ2A.210505.002.2021.05.16.04

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works

Internet connectivity: Works
Internet browsing: Works
Vanadium use Works
Video playback: Works
Renders websites: Works

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Working
Alarms/Timer: n/a

Cameras (Front and Rear): Works,

Handset Microphones: Works
Handset Speakers: Works

Keyboards: Works

File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: n/a
Log Out Profiles: n/a
Seedvault Backups: n/a

Beta Testing Checklist

Date: April 6th, 2021
Device: Flame (Pixel 4)
Build number: RQ2A.210305.006.2021.04.05.20

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use Works

• Video playback: Works
• Renders websites: Works

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Working
Alarms: Not Tested
Timer: Works
Cameras (Front and Rear): Works
Video: Works (The bug in selfie video camera on OpenCamera is preexisting and caused by an upstream issue. A workaround is in place.)
Handset Microphones: Works
Handset Speakers: Works
USB Devices & Peripherals: Works

• USB Mass Storage: Works
• Keyboards: Works
• USB Digital Audio Output: Works

File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Seedvault Backups: Works

Other Notes:
Everything looks good so far. I didn't find anything broken.

Device Information

Date: January 10th, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.211205.017.2022011009

Core Functionality

Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use

• Internet browsing: Works
• Video playback: Works
• Renders websites: Works
• Downloads: Works
• General Browsing: Works

Networking

Mobile Network

Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
5G Connectivity: Not supported by carrier
IPv6: Not supported by carrier

Wi-Fi

Wi-Fi connectivity: Works
Wi-Fi calling: Listed as supported by Freedom Mobile (link) but having difficulty. Will do further testing.
IPv6: Works

Sound and Devices

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Works
USB Digital Audio Output: Works
USB Digital Audio Input: Works

Files

File Browsing: Works
Media Transfer to PC: Works

Profiles

Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works

Sandboxed Play Services

Browsers capable of using Sandboxed Play Services U2F: Firefox for Android, Microsoft Edge for Android
Browsers not capable of using Sandboxed Play Services U2F: Brave, Opera
Unprivileged Installation of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested

Seedvault Backups

Owner Profile

Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not tested

Secondary Profile

Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not tested

Other Notes

Nothing seems to be broken. All is well.

Device Information

Date: December 9th, 2021
Device: Flame (Pixel 4)
Build number: SQ1A.211205.008.2021120717

Core Functionality

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Internet browsing: Works
Vanadium use

• Video playback: Works
• Renders websites: Works
• Downloads: Works
• General Browsing: Works

Sound and Devices

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video: Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Works
USB Digital Audio Output: Works

Files

File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works

Sandboxed Play Services

Sandboxed Play Services: Works
Google Camera App: Works
Push Notifications: Works
Banking Apps (Not requiring safety net): Works

Seedvault Backups

• Owner Profile: Works
• Secondary Profile: Not Tested

Upstream: When taking a backup with "Backup Files" selected to a USB Drive, Seedvault will report that a backup has failed in the notifications bar, but when investigated in the "Backup Status" window, reports a successful backup. It will indicate that Seedvault is backing up files, but then stop at 100% and hang, and the notification bubble will not disappear until the phone has been rebooted. This issue may be for upstream.

Other Notes:
Everything seems to be in good working order.

Beta Testing Checklist

Date: February 28th, 2021
Device: Flame (Pixel 4)
Build number: RQ1A.210205.004.2021.02.26.16

Receive incoming calls: Working
Make outgoing phone calls: Working
Receive incoming texts: Working
Send outgoing texts: Working
Internet connectivity: Working
Internet browsing: Working
Vanadium use

• Video playback: Working
• Renders websites: Working

Media playback:
PDF Viewer: Working
Alarms/Timer: Not Tested
Cameras (Front and Rear): Working
Video: Working
Microphones: Working
USB Devices & Peripherals: Working
File Browsing: Working
Media Transfer to PC: Working
Application Installs: Working
Switch Between Profiles: Working
Log Out Profiles: In Progress
Seedvault Backups: Working

Other Notes:
Done. Looks good.

Sargo SPA2.220505.008.2022111100 Alpha Test Result

Device Information

Date: November 11, 2022
Device: Sargo (Pixel 3a)
Build number: SPA2.220505.008.2022111100
Updated from: SPA2.220505.008.2022090700

✓ Core Functionality

☑ Application Installs: Works
☑ Apps Polling/Push (w/ and w/o Play): Works
☑ Location Services (w/ and w/o Play): Works
☑ Biometrics Login: Works
☑ Vanadium use:

• Internet browsing: Works
• Video playback: Works
• Renders websites: Works
• Downloads: Works
• General Browsing: Works
• Location In Browser (w/ and w/o Play Services): Works

Networking

✓ Mobile Network

☑ Receive incoming calls (Mobile): Works
☑ Make outgoing phone calls (Mobile): Works
☑ Receive incoming SMS: Works
☑ Send outgoing SMS: Works
☑ Receive incoming MMS: Works
☑ Send outgoing MMS: Works
☑ Data connectivity: Works

✓ Wi-Fi

☑ Wi-Fi connectivity: Works
☐ Wi-Fi calling: N/A
☑ IPv6: Works

✓ Sound and Devices

☑ Media playback: Works
☑ Bluetooth Audio Pairing: Works
☑ Bluetooth Audio Playback: Works
☑ Bluetooth Audio Calling: Works
☑ PDF Viewer: Works
☑ Alarms: Works
☑ Timer: Works
☑ Cameras (Front and Rear): Works
☑ Video Cameras (Front and Rear): Works
☑ Handset Microphones: Works
☑ Handset Speakers: Works
☑ USB Mass Storage: Works
☐ USB Keyboards: N/A
☐ USB Digital Audio Output: N/A
☐ USB Digital Audio Input: N/A

✓ Files

☑ File Browsing: Works
☑ Media Transfer to PC: Works

✓ Profiles

☑ Switch Between Profiles: Works
☑ Log Out Profiles: Works
☑ Auditor Local Pairing: Works

✓ Sandboxed Play Services

☑ Log In & Activate Play Services: Works
☐ Browsers capable of using Sandboxed Play Services U2F: N/A
☐ Browsers not capable of using Sandboxed Play Services U2F: N/A
☑ Unprivileged Installation of Apps via Play Store: Works
☑ Unprivileged Update of Apps via Play Store: Works
☑ Banking Apps (BMO): Works
☑ Google Push Notifications: Works

Device Information

Date: February 14th, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.220205.003.2022021314

Core Functionality

Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use

• Internet browsing: Works
• Video playback: Works
• Renders websites: Works
• Downloads: Works
• General Browsing: Works

Networking

Mobile Network

Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works, sending group MMS to multiple recipients was performed successfully.
Data connectivity: Works
5G Connectivity: Not supported by carrier, 4G and 3G only.
IPv6: Not supported by carrier

Wi-Fi

Wi-Fi connectivity: Works
Wi-Fi calling: Not Tested
IPv6: Works

Sound and Devices

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Not Tested
USB Digital Audio Output: Works
USB Digital Audio Input: Works

Files

File Browsing: Works
Media Transfer to PC: Works

Profiles

Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works

Sandboxed Play Services

Browsers capable of using Sandboxed Play Services U2F: Not Tested
Browsers not capable of using Sandboxed Play Services U2F: Not Tested
Unprivileged Installation of Apps via Play Store: Works
Unprivileged Update of Apps via Play Store: Works. Note: Occasionally, updating of some apps causes the consent dialogue to appear for confirmation of an unprivileged installation.
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested
"Sandboxed Play Services is Running" Notification: Works

Seedvault Backups

Owner Profile

Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not Tested

Secondary Profile

Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested

Other Notes

Nothing broken. The new icons display properly and look like an improvement over the previous version.

Beta Testing Checklist

Date: April 24th, 2021
Device: Flame (Pixel 4)
Build number: RQ2A.210405.005.2021.04.22.20

Receive incoming calls: Works
Make outgoing phone calls: Not Tested
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use Works

• Video playback: Works
• Renders websites: Works

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Working
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video: Works (The bug in selfie video camera on OpenCamera is preexisting and caused by an upstream issue. A workaround is in place.)
Handset Microphones: Works
Handset Speakers: Works
USB Devices & Peripherals:

• USB Mass Storage: Works
• Keyboards: Works
• USB Digital Audio Output: Works

File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Not Tested
Log Out Profiles: Not Tested
Seedvault Backups: Works

Other Notes:
Everything looks good so far. I didn't find anything broken.

The known hard crash bug when unplugging a USB keyboard was observed when testing this build, however, it cannot be reproduced at this point in time.

Setup

Device: Flame (Pixel 4)
Release Version: RQ3A.210605.005.2021.06.20.20
Date: June 22nd, 2021

Stage 1: Test IPv6 Connectivity with WiFi on and Mobile Data off

Method

The phone was rebooted after updating to release version RQ3A.210605.005.2021.06.20.20. WiFi was turned on. Due to the lack of provider support for IPv6 on Mobile Data, Mobile Data was initially switched off to force the phone to rely on IPv6.

Vanadium was opened and the following websites were visited:

• https://test-ipv6.com in both TLS and plaintext versions.
• https://ipv6-test.com
• https://ipv6test.google.com in both TLS and plaintext versions.

Expected Results

All websites would report IPv6 as being functioning and working.

Observed Results

No deviation from expected results.

Stage 2: Test IPv6 Connectivity with WiFi on and Mobile Data on, but Unsupported

Method

After running Stage 1, Mobile Data was turned back on, with a mobile service provider that did not support IPv6 and the test repeated.

Expected Results

No change from the results in Stage 1. The phone would continue to connect the same way, through the WiFi.

Observed Results

No deviation from expected results.

Control: Test IPv6 Connectivity with unsupported Mobile Data

Method

As a control, the same test was run with WiFi off and Mobile Data enabled, with a service provider that does not yet support IPv6.

Expected Results

All the test websites would either be unreachable, or fall back to IPv4 and report IPv6 would be nonfunctional.

Observed Results

No deviation from expected results.

Conclusions

IPv6 networking for HTTP is working as intended on WiFi. Mobile Data has been left untested for the time being.

Beta Testing Checklist

Device: Bonita(Pixel 3a XL)
Build number: RQ3A.210605.005.2021.06.09.13

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works

Internet connectivity: Works
Internet browsing: Works
Vanadium use Works
Video playback: Works
Renders websites: Works

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms/Timer: Works

Cameras (Front and Rear): Works

Handset Microphones: Works
Handset Speakers: Works

Keyboards: Works

File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Seedvault Backups: n/a

Date: May 20th, 2021
Device: Sargo (Pixel 3a)
Build number: RQ2A.210505.002.2021.05.19.06

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Internet browsing: Works
Vanadium use Works

Video playback: Works
Renders websites: Works
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Works
Timer: Works
Cameras (Front and Rear): Works
Video: Works
Handset Microphones: Works
Handset Speakers: Works

USB Devices & Peripherals:

USB Mass Storage: Works
Keyboards: Not Tested
USB Digital Audio Output: Not Tested
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works

Seedvault Backups:

Owner Profile: Not Tested
Secondary Profile: Not Tested
Customization: Not Tested

Other Notes:

Will updated Seedvault backup/restore results soon.

EDIT:

Seedvault Backups/Restore:

Owner Profile: Works
Secondary Profile: Works
Customization: Works*

Other Notes:

*Customization: personalized wallpaper did not restore in secondary profile.

App and appdata that was permitted to be backed up and restored worked.

System Navigation was set to Gesture Navigation prior to update. After the update Gesture Navigation issue with Left/Right swiping would not work. Needed to press a back button where applicable.

Fix that worked for me:
Select a different system navigation method and then reactivate Gesture navigation.

Date: June 09, 2021
Device: Flame (Pixel 4)
Build number: RQ3A.210605.005.2021.06.08.06

Stage 1 Test: Regular Use

Procedure

The phone was switched on and unlocked to the owner profile, and the setting in Settings -> Security -> Auto Reboot changed to *1 hour. For the next 2 hours, the phone was locked and unlocked, and used as normal for various tasks including texting, calls, internet browsing, and running apps. Internet access was allowed during this time, during both Wi Fi and Cellular Service. No other profile was in service at the time.

Expected Outcome

The phone would remain running without shutting down, so long as the phone was not left unattended and time between unlock exceeded more than 1 hour.

Observed Outcome

The phone worked fine. No deviations from expected outcome.

Stage 2 Test: Idle

Procedure

The phone was left with its settings from the previous stage. The power button was tapped to return the phone to its lock screen. To avoid interference via the facial unlock system, the phone was placed an arms' length on a desk. At approximately halfway through the test, the phone was checked by tapping the power button once to wake the screen, but not unlocked. This continued for one hour. After an hour had passed, the phone was checked.

Expected Outcome

The phone would be locked, and display a prompt to show that the phone had rebooted and was now expecting a password authentication. The facial recognition sensor would be inactivated.

Observed Outcome

As expected. The phone worked fine. No deviations from expected outcome.

Conclusions

The auto-reboot function is working as expected.

Beta Testing Checklist

Date: March 20th, 2021
Device: Flame (Pixel 4)
Build number: RQ2A.210305.006.2021.03.19.14

Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use Works

• Video playback: Works
• Renders websites: Works

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Working
Alarms/Timer:
Cameras (Front and Rear): Works
Video: Works (The bug in selfie video camera on OpenCamera is preexisting and caused by an upstream issue. A workaround is in place.)
Handset Microphones: Works
Handset Speakers: Works
USB Devices & Peripherals:

• USB Mass Storage: Works
• Keyboards: Works
• USB Digital Audio Output: Works

File Browsing:
Media Transfer to PC:
Application Installs:
Switch Between Profiles:
Log Out Profiles:
Seedvault Backups:

Other Notes:

Device Information

Date: January 31st, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.220105.007.2022013010

Core Functionality

Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use

• Internet browsing: Works
• Video playback: Works
• Renders websites: Works
• Downloads: Works
• General Browsing: Works

Networking

Mobile Network

Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works, sending group MMS to multiple recipients was performed successfully.
Data connectivity: Works
5G Connectivity: Not supported by carrier, 4G and 3G only.
IPv6: Not supported by carrier

Wi-Fi

Wi-Fi connectivity: Works
Wi-Fi calling: As per existing: #31 (comment)
IPv6: Works

Sound and Devices

Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Not Tested
USB Digital Audio Output: Works
USB Digital Audio Input: Works

Files

File Browsing: Works
Media Transfer to PC: Works

Profiles

Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works

Sandboxed Play Services

Browsers capable of using Sandboxed Play Services U2F: No change from previous (Firefox for Android, Microsoft Edge for Android both work with Sandboxed Play Services for U2F)
Browsers not capable of using Sandboxed Play Services U2F: No change from previous, but this isn't our bug (Brave errors out, Opera errors out)
Unprivileged Installation of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested
Unprivileged Installation of Apps via Play Store: Works
"Sandboxed Play Services is Running" Notification: Works

Seedvault Backups

Owner Profile

Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not tested

Secondary Profile

Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested

Other Notes

The new Sandboxed Play Services Dialogue works perfectly.