grapheneos-archive / beta-feedback Goto Github PK
View Code? Open in Web Editor NEWThis repository is used to provide an issue tracker for feedback on Beta releases.
Home Page: https://grapheneos.org/releases#about-the-releases
This repository is used to provide an issue tracker for feedback on Beta releases.
Home Page: https://grapheneos.org/releases#about-the-releases
Beta Testing Checklist
Date: June 22, 2021
Device: 3a
Build number: RQ3A.210605.005.2021.06.20.20
Receive incoming calls: Yes
Make outgoing phone calls: Yes
Receive incoming texts: Yes
Send outgoing texts: Yes
Internet connectivity: Yes
Internet browsing: Yes
Vanadium use:
Other Notes:
Was not able to test IPv6
Date: May 30th, 2021
Device: Flame (Pixel 4)
Build number: RQ2A.210505.002.2021.05.29.09
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Internet browsing: Works
Vanadium use Works
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video: Works (The bug in selfie video camera on OpenCamera is preexisting and caused by an upstream issue. A workaround is in place.)
Handset Microphones: Works
Handset Speakers: Works
USB Devices & Peripherals:
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works (The bug in fingerprints being wiped from the enclave when ending session on another profile is not observed on the 4)
Log Out Profiles: Works
Seedvault Backups:
Customization: Not Tested
Other Notes:
Everything looks good so far. I didn't find anything broken that wasn't broken before.
Beta Testing Checklist
Device: Sunfish(Pixel 4A)
Build number: RQ2A.210505.002.2021.05.04.01
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use Works
Video playback: Works
Renders websites: Works
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Working
Alarms/Timer: n/a
Cameras (Front and Rear): Works,
Handset Microphones: Works
Handset Speakers: Works
Keyboards: Works
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: n/a
Log Out Profiles: n/a
Seedvault Backups: n/a
Date: December 20th, 2021
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.211205.017.202122018
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Internet browsing: Works
Apps Polling/Push (without Play): Works
Location Services: Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Works
Timer: Works
Cameras (Front and Rear): Works
Video: Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Works
USB Digital Audio Output: Works
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works
Log In to Play Services with U2F on App Store: Works
Unprivileged Installation of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Play Services Fails Gracefully if Network Permission Revoked: Denial of Network permission does not appear to cause Play Services to exhibit excessive battery consumption. Play Store appears to work offline if Network permission is denied.
Google Push Notifications: Not Tested
Initializing the backup: Not Tested
Taking the backup: Flakey (See attached logcat below. Resolved, currently unable to reproduce but logs have been captured.)
Restoring from backup: Not tested
Initializing the backup: Works
Taking the backup: Works
Restoring from backup: Not tested
The first time after the reboot that Seedvault was run, the following error was produced and captured via adb logcat
Workaround: The phone was rebooted and the test case run again. After rebooting, the backup continued normally.
12-20 21:52:17.288 14078 14078 W com.stevesoltys.seedvault: unable to execute idmap2: Permission denied
12-20 21:52:17.288 14078 14078 W OverlayConfig: 'idmap2 create-multiple' failed: no mutable="false" overlays targeting "android" will be loaded
12-20 21:52:17.302 14078 14078 V GraphicsEnvironment: ANGLE Developer option for 'com.stevesoltys.seedvault' set to: 'default'
12-20 21:52:17.302 14078 14078 V GraphicsEnvironment: ANGLE GameManagerService for com.stevesoltys.seedvault: false
12-20 21:52:17.302 14078 14078 V GraphicsEnvironment: Neither updatable production driver nor prerelease driver is supported.
12-20 21:52:17.302 14078 14078 D NetworkSecurityConfig: No Network Security Config specified, using platform default
12-20 21:52:17.302 14078 14078 D NetworkSecurityConfig: No Network Security Config specified, using platform default
12-20 21:52:17.305 14078 14078 D CompatibilityChangeReporter: Compat change id reported: 1531297613045645771; UID 10030; state: DISABLED
12-20 21:52:17.305 14078 14078 D CompatibilityChangeReporter: Compat change id reported: 7528921493777479941; UID 10030; state: DISABLED
12-20 21:52:17.313 580 2784 W libperfmgr: Failed to write to node: /sys/devices/platform/1c500000.mali/power_policy with value: always_on, fd: -1
12-20 21:52:17.316 14078 14108 D mali_cmarp_predictor: checking cmar_predictor for com.stevesoltys.seedvault
12-20 21:52:17.339 12597 13164 W DocumentsProvider: Failed during query
12-20 21:52:17.339 12597 13164 W DocumentsProvider: java.io.FileNotFoundException: No root for 096C-1A15
12-20 21:52:17.339 12597 13164 W DocumentsProvider: at com.android.externalstorage.ExternalStorageProvider.getRootFromDocId(ExternalStorageProvider.java:447)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: at com.android.externalstorage.ExternalStorageProvider.getFileForDocId(ExternalStorageProvider.java:411)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: at com.android.externalstorage.ExternalStorageProvider.getFileForDocId(ExternalStorageProvider.java:406)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: at com.android.internal.content.FileSystemProvider.getFileForDocId(FileSystemProvider.java:684)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: at com.android.internal.content.FileSystemProvider.includeFile(FileSystemProvider.java:598)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: at com.android.internal.content.FileSystemProvider.queryDocument(FileSystemProvider.java:371)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: at android.provider.DocumentsProvider.query(DocumentsProvider.java:924)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: at android.content.ContentProvider$Transport.query(ContentProvider.java:272)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: at android.content.ContentProviderNative.onTransact(ContentProviderNative.java:107)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: at android.os.Binder.execTransactInternal(Binder.java:1179)
12-20 21:52:17.339 12597 13164 W DocumentsProvider: at android.os.Binder.execTransact(Binder.java:1143)
12-20 21:52:17.339 14078 14120 W DocumentFile: Failed query: java.lang.NullPointerException: Attempt to invoke interface method 'boolean android.database.Cursor.moveToFirst()' on a null object reference
12-20 21:52:17.370 14078 14078 D AndroidRuntime: Shutting down VM
--------- beginning of crash
12-20 21:52:17.370 14078 14078 E AndroidRuntime: FATAL EXCEPTION: main
12-20 21:52:17.370 14078 14078 E AndroidRuntime: Process: com.stevesoltys.seedvault, PID: 14078
12-20 21:52:17.370 14078 14078 E AndroidRuntime: java.lang.RuntimeException: Unable to start service com.stevesoltys.seedvault.storage.StorageBackupService@68b9cfa with null: java.lang.NullPointerException: Parameter specified as non-null is null: method kotlin.jvm.internal.Intrinsics.checkNotNullParameter, parameter intent
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at android.app.ActivityThread.handleServiceArgs(ActivityThread.java:4659)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at android.app.ActivityThread.access$2000(ActivityThread.java:248)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at android.app.ActivityThread$H.handleMessage(ActivityThread.java:2092)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at android.os.Handler.dispatchMessage(Handler.java:106)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at android.os.Looper.loopOnce(Looper.java:201)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at android.os.Looper.loop(Looper.java:288)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at android.app.ActivityThread.main(ActivityThread.java:7841)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at java.lang.reflect.Method.invoke(Native Method)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:548)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at com.android.internal.os.ExecInit.main(ExecInit.java:48)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at com.android.internal.os.RuntimeInit.nativeFinishInit(Native Method)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at com.android.internal.os.RuntimeInit.main(RuntimeInit.java:355)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: Caused by: java.lang.NullPointerException: Parameter specified as non-null is null: method kotlin.jvm.internal.Intrinsics.checkNotNullParameter, parameter intent
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at org.calyxos.backup.storage.backup.BackupService.onStartCommand(Unknown Source:2)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at android.app.ActivityThread.handleServiceArgs(ActivityThread.java:4641)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: ... 11 more
12-20 21:52:17.370 14078 14078 E AndroidRuntime: Error reporting crash
12-20 21:52:17.370 14078 14078 E AndroidRuntime: java.lang.RuntimeException: Bad file descriptor
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at android.os.BinderProxy.transactNative(Native Method)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at android.os.BinderProxy.transact(BinderProxy.java:571)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at android.app.IActivityManager$Stub$Proxy.handleApplicationCrash(IActivityManager.java:5294)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at com.android.internal.os.RuntimeInit$KillApplicationHandler.uncaughtException(RuntimeInit.java:156)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at java.lang.ThreadGroup.uncaughtException(ThreadGroup.java:1073)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at java.lang.ThreadGroup.uncaughtException(ThreadGroup.java:1068)
12-20 21:52:17.370 14078 14078 E AndroidRuntime: at java.lang.Thread.dispatchUncaughtException(Thread.java:2200)
12-20 21:52:17.370 14078 14078 I Process : Sending signal. PID: 14078 SIG: 9
12-20 21:52:17.388 1488 9334 I ActivityManager: Process com.stevesoltys.seedvault (pid 14078) has died: fg TOP
12-20 21:52:17.389 754 754 I Zygote : Process 14078 exited due to signal 9 (Killed)
12-20 21:52:17.389 1488 1596 I libprocessgroup: Successfully killed process cgroup uid 10030 pid 14078 in 0ms
12-20 21:52:17.389 1488 6332 I WindowManager: WIN DEATH: Window{1b946ea u0 com.stevesoltys.seedvault/com.stevesoltys.seedvault.settings.SettingsActivity}
12-20 21:52:17.389 1488 6332 W InputManager-JNI: Input channel object '1b946ea com.stevesoltys.seedvault/com.stevesoltys.seedvault.settings.SettingsActivity (client)' was disposed without first being removed with the input manager!
12-20 21:52:17.394 1488 9334 W ActivityManager: Scheduling restart of crashed service com.stevesoltys.seedvault/.storage.StorageBackupService in 67108864000ms for start-requested
12-20 21:52:17.395 1488 9334 W ActivityTaskManager: Force removing ActivityRecord{2aa9871 u0 com.stevesoltys.seedvault/.settings.SettingsActivity t463}: app died, no saved state
12-20 21:52:17.396 580 2784 W libperfmgr: Failed to write to node: /sys/devices/platform/1c500000.mali/power_policy with value: always_on, fd: -1
12-20 21:52:17.409 580 2784 W libperfmgr: Failed to write to node: /sys/devices/platform/1c500000.mali/power_policy with value: always_on, fd: -1
12-20 21:52:17.413 1488 1586 W ActivityManager: setHasOverlayUi called on unknown pid: 14078
12-20 21:52:17.414 1488 9334 I SystemUpdateManagerService: No existing info file /data/system/system-update-info.xml
12-20 21:52:17.414 2284 2284 D SysUpdatePrefContr: Update statue unknown
12-20 21:52:17.414 2284 2284 D AssistGesture: mAssistOnly:false, isSupported:false, isSensorAvailable:false
12-20 21:52:17.417 2284 5641 D SettingsActivity: No enabled state changed, skipping updateCategory call
Looks great, seems to be working.
Date: March 11th, 2022
Device: Raven (Pixel 6 Pro)
Build number: S2B3.220205.007.A1.2022031103
Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use
Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
5G Connectivity: Not supported by carrier, 4G and 3G only.
IPv6: Not supported by carrier
Wi-Fi connectivity: Works
Wi-Fi calling: Not Tested
IPv6: Works
Media playback: Works
Bluetooth Audio Pairing: Not Tested
Bluetooth Audio Playback: Not Tested
Bluetooth Audio Calling: Not Tested
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Not Tested
USB Digital Audio Output: Not Tested
USB Digital Audio Input: Not Tested
File Browsing: Works
Media Transfer to PC: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works
Log In & Activate Play Services: Works.
Unprivileged Installation of Apps via Play Store: Works
Unprivileged Update of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested
"Sandboxed Play Services is Running" Notification: Works
Initializing the backup: Not Tested
Taking the backup: Works, but Seedvault reports a backup not taken successfully error.
Restoring from backup: Not Tested
Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested
Nothing broken so far. U2F via Sandboxed Play Services has not been tested, but was found to work with Play Services login.
Date: January 7th, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.211205.017.2022010500
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video: Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Not Tested
USB Digital Audio Output: Works
USB Digital Audio Input: Works
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works
Log In to Play Services with U2F on App Store: Not Tested
Browsers Capable of using Sandboxed Play Services U2F: Firefox for Android, Microsoft Edge for Android
Unprivileged Installation of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested
Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not tested
Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not tested
Nothing seems to be broken. All is well.
Date: March 3rd, 2021
Device: Flame (Pixel 4)
Build number: RQ1A.210205.004.2021.03.02.10
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use
Media playback: Works
PDF Viewer: Works
Alarms/Timer: In Progress
Cameras (Front and Rear): Works
Video: Works
Microphones: Works
USB Devices & Peripherals: In Progress
File Browsing: In Progress
Media Transfer to PC: In Progress
Application Installs: In Progress
Switch Between Profiles: In Progress
Log Out Profiles: In Progress
Seedvault Backups: In Progress
Other Notes:
All in progress, will finish testing soon.
Beta Testing Checklist
Date: April 17, 2021
Device: 3a
Build number: RQ2A.210405.005.2021.04.16.04
Recieve incoming calls: Works
Make outgoing phone calls: Yes
Recieve incoming texts: Yes
Send outgoing texts: Yes
Internet connectivity: Yes
Internet browsing: Yes
Vanadium use:
Other Notes:
Phone working as expected.
Date: December 15th, 2021
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.211205.017.2021121421
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Internet browsing: Works
Location Services: Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video: Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Not Tested
USB Digital Audio Output: Works
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works
Sandboxed Play Services: Not Tested
Google Camera App: Not Tested
Push Notifications: Not Tested
Banking Apps (Not requiring safety net): Not Tested
Anything in this section is upstream!
Owner Profile: Works (See Below)
Secondary Profile: Not tested
Testing Signal 5.27.13 when Network Permission was revoked produced the desired effect of the app continuing to function offline, rather than crash when Network Permission was denied. The app functioned normally once Network Permission was restored. Conclusions: The changes to the new Network Permission model are working as they are intended.
Everything seems to be in good working order.
I did not test Sandboxed Play Services this time due to some time constraints.
Date: January 15th, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.211205.007.2022011423
Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use
Receive incoming calls (Mobile):
Make outgoing phone calls (Mobile):
Receive incoming SMS: Yes
Send outgoing SMS: Yes
Receive incoming MMS: Yes
Send outgoing MMS: Yes
Data connectivity: Yes
5G Connectivity: Not supported by carrier
IPv6: Not supported by carrier
Wi-Fi connectivity: Works
Wi-Fi calling: Listed as supported by Freedom Mobile (link) Test results are unchanged from this test in #31 (comment) originally reported January 10th, 2022.
IPv6: Works
Media playback: Works
Bluetooth Audio Pairing: Not Tested
Bluetooth Audio Playback: Not Tested
Bluetooth Audio Calling: Not Tested
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Works (Unable to reproduce previous issue)
USB Digital Audio Output: Works
USB Digital Audio Input: Works
File Browsing: Works
Media Transfer to PC: Not Tested
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works
Browsers capable of using Sandboxed Play Services U2F: Not Tested
Browsers not capable of using Sandboxed Play Services U2F: Not Tested
Unprivileged Installation of Apps via Play Store: Not Tested
Banking Apps (not requiring Safetynet Check): Not Tested
Google Push Notifications: Not Tested
Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not tested
Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested
No new breakages reported so far.
Date: March 2nd, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.220205.003.2022022818
Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use
Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
5G Connectivity: Not supported by carrier, 4G and 3G only.
IPv6: Not supported by carrier
Wi-Fi connectivity: Works
Wi-Fi calling: Not Tested
IPv6: Works
Media playback: Works
Bluetooth Audio Pairing: Not Tested
Bluetooth Audio Playback: Not Tested
Bluetooth Audio Calling: Not Tested
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Not Tested
USB Digital Audio Output: Not Tested
USB Digital Audio Input: Not Tested
File Browsing: Works
Media Transfer to PC: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works
Log In & Activate Play Services: Works, previous issue has been solved.
Browsers capable of using Sandboxed Play Services U2F: BROKEN - Play Services requests permission to storage, even when permission for Files and media is granted. However, U2F works to log in to Play Services. Microsoft Edge for Android crashes when requesting U2F, Firefox encounters an error where it complains that Play Services needs permission to storage. Further investigation pending.
Browsers not capable of using Sandboxed Play Services U2F: Not Tested
Unprivileged Installation of Apps via Play Store: Works
Unprivileged Update of Apps via Play Store: Not Tested
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested
"Sandboxed Play Services is Running" Notification: Works
Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not Tested
Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not tested
Nothing broken so far. The previous issue with Play Services freezing with a SecurityException
Error when authenticating to Play Services has been fixed.
The "Apps" app is working as expected.
Some apps reliant on Play Services for U2F that previously worked before are currently broken. I will investigate further on this.
Date: March 24th, 2022
Device: Raven (Pixel 6 Pro)
Build number: SP2A.220305.013.A3.2022032110
Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use
Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
5G Connectivity: Not supported by carrier, 4G and 3G only.
IPv6: Not supported by carrier
Wi-Fi connectivity: Works
Wi-Fi calling: Not Tested
IPv6: Works
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Not Tested
PDF Viewer: Works
Alarms: Works
Timer: Works
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Not Tested
USB Keyboards: Not Tested
USB Digital Audio Output: Not Tested
USB Digital Audio Input: Not Tested
File Browsing: Works
Media Transfer to PC: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Not Tested
Auditor Remote Attestation: Works
Log In & Activate Play Services: Works
Unprivileged Installation of Apps via Play Store: Works
Unprivileged Update of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested
"Sandboxed Play Services is Running" Notification: Works
Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not Tested
Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested
Nothing broken.
Beta Testing Checklist
Date: May 17, 2021
Device: 3a
Build number: RQ2A.210505.002.2021.05.16.04
Receive incoming calls: Yes
Make outgoing phone calls: Yes
Receive incoming texts: Yes
Send outgoing texts: Yes
Internet connectivity: Yes
Internet browsing: Yes
Vanadium use:
Other Notes:
Aurora temp down, could not test app install.
Device: bramble (Pixel 4a 5G)
Build number: RQ2A.210505.003.2021.05.16.04
Receive incoming calls: Works (VoLTE, Legacy, and VoWiFi)
Make outgoing phone calls: Works (VoLTE, Legacy, and VoWiFi)
Receive incoming texts: Works
Send outgoing texts: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use:
Video playback: Works (YouTube, Dailymotion, Viprow)
Renders websites: Works (YouTube, Dailymotion, Viprow, duckduckgo, amazon, https://wiki.codeaurora.org/xwiki/bin/QAEP/release)
Media playback: Works (avi/mkv/aac/flac)
PDF Viewer: Works (3 documents)
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
NFC: Works
Alarms: Works
Timer: Works
Cameras (Front and Rear): Works
Video: Works
Handset Microphones: Works
Handset Speakers: Works
USB Devices & DACs: Works
USB Mass Storage: Works
Keyboards: Partial Working (known USB Keyboard crash bug still applies)
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Owner Profile Seedvault Backups: Works
Owner Profile Seedvault Restore: Works
Secondary User Profile Seedvault Backups: Works
Secondary User Profile Seedvault Restore: Works
Date: February 24th, 2021
Device: Flame (Pixel 4)
Build Number: RQ1A.210205.004.2021.02.23.15
USB Audio Playback with Digital USB-C to 1/8" Adapter: Working
USB Audio Recording with Digital USB-C to 1/8" Adapter: Not Tested
USB Audio Output with USB-C Headset: Working
USB Audio Recording with USB-C Headset Microphone: Working
Onboard Audio Playback: Working
Onboard Audio Recording: Working
Bluetooth Audio Playback: Working
Bluetooth Audio Recording Working
Still Camera on Back Side: Not Tested
Still Camera on Screen Side: Not Tested
Video Camera on Back Side: Not Tested
Video Camera on Screen Side: Not Tested
Switching Between Cameras: Not Tested
If you're on a Pixel 3, 3a, 3XL, or 3aXL, please test the cameras for this update.
Date: October 21th 2021
Device: Flame (Pixel 4)
Build number: SP1A.210812.015.2021102020
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Internet browsing: Works
Vanadium use
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works, tested with GrapheneOS Camera 1.0
Video: Works, tested with GrapheneOS Camera 1.0
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Works
USB Digital Audio Output: Works
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works
Sandboxed Play Services: Works
Google Camera App: Works
Push Notifications: Not Tested
Customization: Works. The Highlight Colours option seems to have been depreciated.
Other Notes:
Thank you for Android 12.
Everything seems to be in good working order.
Date: February 8th, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.220205.003.2022020800
Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use
Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works, sending group MMS to multiple recipients was performed successfully.
Data connectivity: Works
5G Connectivity: Not supported by carrier, 4G and 3G only.
IPv6: Not supported by carrier
Wi-Fi connectivity: Works
Wi-Fi calling: As per existing: #31 (comment)
IPv6: Works
Media playback: Works
Bluetooth Audio Pairing: Not Tested
Bluetooth Audio Playback: Not Tested
Bluetooth Audio Calling: Not Tested
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Not Tested
USB Digital Audio Output: Not Tested
USB Digital Audio Input: Not Tested
File Browsing: Works
Media Transfer to PC: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works
Browsers capable of using Sandboxed Play Services U2F: Not Tested
Browsers not capable of using Sandboxed Play Services U2F: Not Tested
Unprivileged Installation of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested
Unprivileged Installation of Apps via Play Store: Works
"Sandboxed Play Services is Running" Notification: Works
Initializing the backup: Not Tested
Taking the backup: Works, but backup is reported as having failed due to unknown reasons. Will test more extensively later.
Restoring from backup: Not tested
Initializing the backup: Not Tested
Taking the backup: Works.
Restoring from backup: Not tested
GrapheneOS App Store: Works, with one problem as below
New App Icons: Displays fine.
PDF Viewer demands being reinstalled via the "Apps" app, stating that the latest version is 8 even though 9 is currently installed.
Beta Testing Checklist
Device: Bonita(Pixel 3a XL)
Build number: RQ3A.210605.005.2021.06.08.06
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use Works
Video playback: Works
Renders websites: Works
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: n/a
PDF Viewer: Works
Alarms/Timer: Works
Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
Keyboards: Works
File Browsing: Works
Media Transfer to PC: n/a
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Seedvault Backups: n/a
I recorded my previous test in error, so I am repeating it for thoroughness.
The previous test result was here: #31
To expedite the test, some test cases were skipped.
Date: January 11th, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.211205.017.2022011009
Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use
Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
5G Connectivity: Not supported by carrier, 4G and 3G only.
IPv6: Not supported by carrier
Wi-Fi connectivity: Works
Wi-Fi calling: Listed as supported by Freedom Mobile (link) Test results are unchanged from this test in #31 (comment)
IPv6: Works
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Not Tested
Bluetooth Audio Calling: Not Tested
PDF Viewer: Not Tested
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Not Tested
USB Keyboards: Not Tested
USB Digital Audio Output: Not Tested
USB Digital Audio Input: Not Tested
File Browsing: Works
Media Transfer to PC: Not Tested
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works
Browsers capable of using Sandboxed Play Services U2F: Not Tested
Browsers not capable of using Sandboxed Play Services U2F: Not Tested
Unprivileged Installation of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested
Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested
Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested
I'm starting this off as a way for us to centralize and make it easier to call back on Beta Reports.
For reminders, please join the IRC channel #grapheneos-beta on freenode.
Date: February 20th, 2021
Device: Flame (Pixel 4)
Build number: RQ1A.210205.004.2021.02.19.15
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use
Media playback: Works
PDF Viewer: Works
Alarms/Timer: Works
Cameras (Front and Rear): Works
Video: Works
Microphones: Works
USB Devices & Peripherals: Works
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Seedvault Backups: Works
Other Notes:
No breakages noticed so far.
Date: March 31st, 2021
Device: Flame (Pixel 4)
Build number: RQ2A.210305.006.2021.03.30.02
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use Works
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Working
Alarms/Timer: Not Tested
Cameras (Front and Rear): Works
Video: Works (The bug in selfie video camera on OpenCamera is preexisting and caused by an upstream issue. A workaround is in place.)
Handset Microphones: Works
Handset Speakers: Works
USB Devices & Peripherals:
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Not Tested
Switch Between Profiles: Works
Log Out Profiles: Works
Seedvault Backups: Works
Other Notes:
Everything looks good.
Date: December 19th, 2021
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.211205.017.202121921
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Internet browsing: Works
Location Services: Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video: Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Works
USB Digital Audio Output: Works
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works
U2F via both NFC and USB to log into Play Store from the Play Store App with an account with Advanced Protection Plan enabled appears to be broken.
Owner Profile: Works
Secondary Profile: Works
Both backing up and restoring from an existing profile, as well as provisioning a new backup in a profile that had never had backups set were tested and verified to be working. File backup and restoration was tested and verified to be working.
Everything seems to be in good working order.
Date: 21 July 2021
Device: Bonito (Pixel 3a XL)
Build number: RQ3A.210705.001.2021.07.19.18
Receive incoming calls: Working
Make outgoing phone calls: Working
Receive incoming SMS: Working
Send outgoing SMS: Working
Receive incoming MMS: Not tested
Send outgoing MMS: Not tested
Data connectivity: Working
Wi-Fi connectivity: Working
Internet browsing: Working
Vanadium use
Media playback: Working
Bluetooth Audio Pairing: Not tested
Bluetooth Audio Playback: Not tested
Bluetooth Audio Calling: Not tested
PDF Viewer: Working
Alarms: Working
Timer: Working
Cameras (Front and Rear): Both working
Video: Working
Handset Microphones: Working
Handset Speakers: Working
USB Devices & Peripherals:
File Browsing: Working
Media Transfer to PC: Working
Application Installs: Working, able to update app via Aurora Store
Switch Between Profiles: Working
Log Out Profiles: Working
Seedvault Backups:
Customization:
Other Notes:
When phone was rebooted after update I was not prompted for my SIM card unlock PIN. Wi-Fi doesn't turn on but silently fails (no error). Phone calls don't work and prompt message 'mobile network not available'. Mobile data can't be turned on and has message 'no SIM card'. Removing and inserting SIM card again doesn't fix. Tested on primary (owner) profile.
EDIT: Addressed in https://app.element.io/#/room/#testing:grapheneos.org 'it was found to be a bad build due to bad linux USB drivers' - June V. Sideload https://releases.grapheneos.org/bonito-ota_update-2021.07.19.18.zip
EDIT 2: Updated checklist.
Date: March 7th, 2021
Device: Flame (Pixel 4)
Build number: RQ2A.210305.006.2021.03.06.00
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use Works
Media playback: Works
PDF Viewer: Works
Alarms/Timer: In Progress
Cameras (Front and Rear): Works
Video: Works
Microphones: Works
USB Devices & Peripherals:
File Browsing:
Media Transfer to PC:
Application Installs: Works
Switch Between Profiles:
Log Out Profiles:
Seedvault Backups:
Other Notes:
All in progress, will finish testing soon.
Date: October 7th 2021
Device: Flame (Pixel 4)
Build number: RQ3A.211001.001.2021100606
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Internet browsing: Works
Vanadium use
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video: Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Works
USB Digital Audio Output: Works
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works
Sandboxed Play Services
Banking App: Works
Google Camera App: Works
Push Notifications: Not tested
Customization: Works.
Other Notes:
No breakages or broken features observed.
Date: January 31st, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.220105.007.2022013120
Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use
Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works, sending group MMS to multiple recipients was performed successfully.
Data connectivity: Works
5G Connectivity: Not supported by carrier, 4G and 3G only.
IPv6: Not supported by carrier
Wi-Fi connectivity: Works
Wi-Fi calling: As per existing: #31 (comment)
IPv6: Works
Media playback: Works
Bluetooth Audio Pairing: Not Tested
Bluetooth Audio Playback: Not Tested
Bluetooth Audio Calling: Not Tested
PDF Viewer: Works
Alarms: Not Tested
Timer: Works
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Not Tested
USB Keyboards: Not Tested
USB Digital Audio Output: Not Tested
USB Digital Audio Input: Not Tested
File Browsing: Works
Media Transfer to PC: Not Tested
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works
Browsers capable of using Sandboxed Play Services U2F: Not Tested
Browsers not capable of using Sandboxed Play Services U2F: Not Tested
Unprivileged Installation of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested
Unprivileged Installation of Apps via Play Store: Works
"Sandboxed Play Services is Running" Notification: Works
Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested
Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested
Nothing seems to be broken.
Beta Testing Checklist
Device: Sunfish(Pixel 4A)
Build number: RQ2A.210505.002.2021.05.16.04
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use Works
Video playback: Works
Renders websites: Works
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Working
Alarms/Timer: n/a
Cameras (Front and Rear): Works,
Handset Microphones: Works
Handset Speakers: Works
Keyboards: Works
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: n/a
Log Out Profiles: n/a
Seedvault Backups: n/a
Date: April 6th, 2021
Device: Flame (Pixel 4)
Build number: RQ2A.210305.006.2021.04.05.20
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use Works
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Working
Alarms: Not Tested
Timer: Works
Cameras (Front and Rear): Works
Video: Works (The bug in selfie video camera on OpenCamera is preexisting and caused by an upstream issue. A workaround is in place.)
Handset Microphones: Works
Handset Speakers: Works
USB Devices & Peripherals: Works
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Seedvault Backups: Works
Other Notes:
Everything looks good so far. I didn't find anything broken.
Date: January 10th, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.211205.017.2022011009
Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use
Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
5G Connectivity: Not supported by carrier
IPv6: Not supported by carrier
Wi-Fi connectivity: Works
Wi-Fi calling: Listed as supported by Freedom Mobile (link) but having difficulty. Will do further testing.
IPv6: Works
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Works
USB Digital Audio Output: Works
USB Digital Audio Input: Works
File Browsing: Works
Media Transfer to PC: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works
Browsers capable of using Sandboxed Play Services U2F: Firefox for Android, Microsoft Edge for Android
Browsers not capable of using Sandboxed Play Services U2F: Brave, Opera
Unprivileged Installation of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested
Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not tested
Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not tested
Nothing seems to be broken. All is well.
Date: December 9th, 2021
Device: Flame (Pixel 4)
Build number: SQ1A.211205.008.2021120717
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Internet browsing: Works
Vanadium use
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video: Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Works
USB Digital Audio Output: Works
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works
Sandboxed Play Services: Works
Google Camera App: Works
Push Notifications: Works
Banking Apps (Not requiring safety net): Works
Upstream: When taking a backup with "Backup Files" selected to a USB Drive, Seedvault will report that a backup has failed in the notifications bar, but when investigated in the "Backup Status" window, reports a successful backup. It will indicate that Seedvault is backing up files, but then stop at 100% and hang, and the notification bubble will not disappear until the phone has been rebooted. This issue may be for upstream.
Other Notes:
Everything seems to be in good working order.
Date: February 28th, 2021
Device: Flame (Pixel 4)
Build number: RQ1A.210205.004.2021.02.26.16
Receive incoming calls: Working
Make outgoing phone calls: Working
Receive incoming texts: Working
Send outgoing texts: Working
Internet connectivity: Working
Internet browsing: Working
Vanadium use
Media playback:
PDF Viewer: Working
Alarms/Timer: Not Tested
Cameras (Front and Rear): Working
Video: Working
Microphones: Working
USB Devices & Peripherals: Working
File Browsing: Working
Media Transfer to PC: Working
Application Installs: Working
Switch Between Profiles: Working
Log Out Profiles: In Progress
Seedvault Backups: Working
Other Notes:
Done. Looks good.
Sargo SPA2.220505.008.2022111100 Alpha Test Result
Date: November 11, 2022
Device: Sargo (Pixel 3a)
Build number: SPA2.220505.008.2022111100
Updated from: SPA2.220505.008.2022090700
☑ Application Installs: Works
☑ Apps Polling/Push (w/ and w/o Play): Works
☑ Location Services (w/ and w/o Play): Works
☑ Biometrics Login: Works
☑ Vanadium use:
☑ Receive incoming calls (Mobile): Works
☑ Make outgoing phone calls (Mobile): Works
☑ Receive incoming SMS: Works
☑ Send outgoing SMS: Works
☑ Receive incoming MMS: Works
☑ Send outgoing MMS: Works
☑ Data connectivity: Works
☑ Wi-Fi connectivity: Works
☐ Wi-Fi calling: N/A
☑ IPv6: Works
☑ Media playback: Works
☑ Bluetooth Audio Pairing: Works
☑ Bluetooth Audio Playback: Works
☑ Bluetooth Audio Calling: Works
☑ PDF Viewer: Works
☑ Alarms: Works
☑ Timer: Works
☑ Cameras (Front and Rear): Works
☑ Video Cameras (Front and Rear): Works
☑ Handset Microphones: Works
☑ Handset Speakers: Works
☑ USB Mass Storage: Works
☐ USB Keyboards: N/A
☐ USB Digital Audio Output: N/A
☐ USB Digital Audio Input: N/A
☑ File Browsing: Works
☑ Media Transfer to PC: Works
☑ Switch Between Profiles: Works
☑ Log Out Profiles: Works
☑ Auditor Local Pairing: Works
☑ Log In & Activate Play Services: Works
☐ Browsers capable of using Sandboxed Play Services U2F: N/A
☐ Browsers not capable of using Sandboxed Play Services U2F: N/A
☑ Unprivileged Installation of Apps via Play Store: Works
☑ Unprivileged Update of Apps via Play Store: Works
☑ Banking Apps (BMO): Works
☑ Google Push Notifications: Works
Date: February 14th, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.220205.003.2022021314
Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use
Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works, sending group MMS to multiple recipients was performed successfully.
Data connectivity: Works
5G Connectivity: Not supported by carrier, 4G and 3G only.
IPv6: Not supported by carrier
Wi-Fi connectivity: Works
Wi-Fi calling: Not Tested
IPv6: Works
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Not Tested
USB Digital Audio Output: Works
USB Digital Audio Input: Works
File Browsing: Works
Media Transfer to PC: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works
Browsers capable of using Sandboxed Play Services U2F: Not Tested
Browsers not capable of using Sandboxed Play Services U2F: Not Tested
Unprivileged Installation of Apps via Play Store: Works
Unprivileged Update of Apps via Play Store: Works. Note: Occasionally, updating of some apps causes the consent dialogue to appear for confirmation of an unprivileged installation.
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested
"Sandboxed Play Services is Running" Notification: Works
Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not Tested
Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested
Nothing broken. The new icons display properly and look like an improvement over the previous version.
Date: April 24th, 2021
Device: Flame (Pixel 4)
Build number: RQ2A.210405.005.2021.04.22.20
Receive incoming calls: Works
Make outgoing phone calls: Not Tested
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use Works
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Working
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video: Works (The bug in selfie video camera on OpenCamera is preexisting and caused by an upstream issue. A workaround is in place.)
Handset Microphones: Works
Handset Speakers: Works
USB Devices & Peripherals:
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Not Tested
Log Out Profiles: Not Tested
Seedvault Backups: Works
Other Notes:
Everything looks good so far. I didn't find anything broken.
The known hard crash bug when unplugging a USB keyboard was observed when testing this build, however, it cannot be reproduced at this point in time.
Device: Flame (Pixel 4)
Release Version: RQ3A.210605.005.2021.06.20.20
Date: June 22nd, 2021
The phone was rebooted after updating to release version RQ3A.210605.005.2021.06.20.20. WiFi was turned on. Due to the lack of provider support for IPv6 on Mobile Data, Mobile Data was initially switched off to force the phone to rely on IPv6.
Vanadium was opened and the following websites were visited:
All websites would report IPv6 as being functioning and working.
No deviation from expected results.
After running Stage 1, Mobile Data was turned back on, with a mobile service provider that did not support IPv6 and the test repeated.
No change from the results in Stage 1. The phone would continue to connect the same way, through the WiFi.
No deviation from expected results.
As a control, the same test was run with WiFi off and Mobile Data enabled, with a service provider that does not yet support IPv6.
All the test websites would either be unreachable, or fall back to IPv4 and report IPv6 would be nonfunctional.
No deviation from expected results.
IPv6 networking for HTTP is working as intended on WiFi. Mobile Data has been left untested for the time being.
Beta Testing Checklist
Device: Bonita(Pixel 3a XL)
Build number: RQ3A.210605.005.2021.06.09.13
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use Works
Video playback: Works
Renders websites: Works
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms/Timer: Works
Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
Keyboards: Works
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Seedvault Backups: n/a
Date: May 20th, 2021
Device: Sargo (Pixel 3a)
Build number: RQ2A.210505.002.2021.05.19.06
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works
Data connectivity: Works
Wi-Fi connectivity: Works
Internet browsing: Works
Vanadium use Works
Video playback: Works
Renders websites: Works
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Works
Timer: Works
Cameras (Front and Rear): Works
Video: Works
Handset Microphones: Works
Handset Speakers: Works
USB Devices & Peripherals:
USB Mass Storage: Works
Keyboards: Not Tested
USB Digital Audio Output: Not Tested
File Browsing: Works
Media Transfer to PC: Works
Application Installs: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Seedvault Backups:
Owner Profile: Not Tested
Secondary Profile: Not Tested
Customization: Not Tested
Other Notes:
EDIT:
Seedvault Backups/Restore:
Owner Profile: Works
Secondary Profile: Works
Customization: Works*
Other Notes:
*Customization: personalized wallpaper did not restore in secondary profile.
App and appdata that was permitted to be backed up and restored worked.
System Navigation was set to Gesture Navigation prior to update. After the update Gesture Navigation issue with Left/Right swiping would not work. Needed to press a back button where applicable.
Fix that worked for me:
Select a different system navigation method and then reactivate Gesture navigation.
Date: June 09, 2021
Device: Flame (Pixel 4)
Build number: RQ3A.210605.005.2021.06.08.06
The phone was switched on and unlocked to the owner profile, and the setting in Settings -> Security -> Auto Reboot changed to *1 hour. For the next 2 hours, the phone was locked and unlocked, and used as normal for various tasks including texting, calls, internet browsing, and running apps. Internet access was allowed during this time, during both Wi Fi and Cellular Service. No other profile was in service at the time.
The phone would remain running without shutting down, so long as the phone was not left unattended and time between unlock exceeded more than 1 hour.
The phone worked fine. No deviations from expected outcome.
The phone was left with its settings from the previous stage. The power button was tapped to return the phone to its lock screen. To avoid interference via the facial unlock system, the phone was placed an arms' length on a desk. At approximately halfway through the test, the phone was checked by tapping the power button once to wake the screen, but not unlocked. This continued for one hour. After an hour had passed, the phone was checked.
The phone would be locked, and display a prompt to show that the phone had rebooted and was now expecting a password authentication. The facial recognition sensor would be inactivated.
As expected. The phone worked fine. No deviations from expected outcome.
The auto-reboot function is working as expected.
Date: March 20th, 2021
Device: Flame (Pixel 4)
Build number: RQ2A.210305.006.2021.03.19.14
Receive incoming calls: Works
Make outgoing phone calls: Works
Receive incoming texts: Works
Send outgoing texts: Works
Internet connectivity: Works
Internet browsing: Works
Vanadium use Works
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Working
Alarms/Timer:
Cameras (Front and Rear): Works
Video: Works (The bug in selfie video camera on OpenCamera is preexisting and caused by an upstream issue. A workaround is in place.)
Handset Microphones: Works
Handset Speakers: Works
USB Devices & Peripherals:
File Browsing:
Media Transfer to PC:
Application Installs:
Switch Between Profiles:
Log Out Profiles:
Seedvault Backups:
Other Notes:
Date: January 31st, 2022
Device: Raven (Pixel 6 Pro)
Build number: SQ1D.220105.007.2022013010
Application Installs: Works
Apps Polling/Push (without Play): Works
Location Services (without Play): Works
Biometrics Login (In-Screen Fingerprint Scanner): Works
Vanadium use
Receive incoming calls (Mobile): Works
Make outgoing phone calls (Mobile): Works
Receive incoming SMS: Works
Send outgoing SMS: Works
Receive incoming MMS: Works
Send outgoing MMS: Works, sending group MMS to multiple recipients was performed successfully.
Data connectivity: Works
5G Connectivity: Not supported by carrier, 4G and 3G only.
IPv6: Not supported by carrier
Wi-Fi connectivity: Works
Wi-Fi calling: As per existing: #31 (comment)
IPv6: Works
Media playback: Works
Bluetooth Audio Pairing: Works
Bluetooth Audio Playback: Works
Bluetooth Audio Calling: Works
PDF Viewer: Works
Alarms: Not Tested
Timer: Not Tested
Cameras (Front and Rear): Works
Video Cameras (Front and Rear): Works
Handset Microphones: Works
Handset Speakers: Works
USB Mass Storage: Works
USB Keyboards: Not Tested
USB Digital Audio Output: Works
USB Digital Audio Input: Works
File Browsing: Works
Media Transfer to PC: Works
Switch Between Profiles: Works
Log Out Profiles: Works
Auditor Local Pairing: Works
Browsers capable of using Sandboxed Play Services U2F: No change from previous (Firefox for Android, Microsoft Edge for Android both work with Sandboxed Play Services for U2F)
Browsers not capable of using Sandboxed Play Services U2F: No change from previous, but this isn't our bug (Brave errors out, Opera errors out)
Unprivileged Installation of Apps via Play Store: Works
Banking Apps (not requiring Safetynet Check): Works
Google Push Notifications: Not Tested
Unprivileged Installation of Apps via Play Store: Works
"Sandboxed Play Services is Running" Notification: Works
Initializing the backup: Not Tested
Taking the backup: Works
Restoring from backup: Not tested
Initializing the backup: Not Tested
Taking the backup: Not Tested
Restoring from backup: Not tested
The new Sandboxed Play Services Dialogue works perfectly.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.