wlauto fails to find Antutu APK about workload-automation HOT 25 CLOSED

the file name should contain the apk version e.g. ~/.workload_automation/dependencies/antutu/com.antutu.ABenchMark-6.0.1.apk

from workload-automation.

Thanks. I had that too but it didn't work so i changed it match
/usr/local/lib/python2.7/dist-packages/wlauto/workloads/antutu/init.py
package = "com.antutu.ABenchMark"

Same result.

from workload-automation.

Is there a specific place to get the APK files. perhaps the one i have works on my phone but isn't recoginzed by wlauto? i used the APK files from https://www.apk4fun.com/apk/32203/ is that ok?

from workload-automation.

Due to copyright reasons we are unable to distribute the APK files ourselves. As long as the apk version matches it should work. The package name inside the workload is used when launching the APK, its not used in the resource resolution stage, as long as you have a file in /.workload_automation/dependencies/antutu that contains the version number and ends in .apk it will be found. So you can you confirm you have put the correct version APK file here:
~/.workload_automation/dependencies/antutu/com.antutu.ABenchMark-6.0.1.apk

from workload-automation.

hi, thanks for your help. Yes, I did place the 6.0.1 APK inside of ~/.workload_automation/dependencies/antutu and it was not found. I will try again today with the specific name you APK mentioned. Also, does it matter if the android device has a production version of Android? Does wa need root access to the phone?

from workload-automation.

Some features of WA will require root but a lot of workloads work fine without it. Also WA does not require a production version of Android but be wary of issues with pre-production builds that may prevent WA from working properly.

from workload-automation.

Thanks. so in theory it should work fine. if I put the 6.0.1 apk in ~/.workload_automation/dependencies/antutu and try and run it on a production build device it should work. Should I attach the log file, would that help indicate what is wrong? it doesn't say much except that it found the JAR file inside of the python folder structure and that it can't find the APK even though I 1. put it in ~/.workload_automation/dependencies/antutu 2. put it in /usr/local/lib/python2.7/dist-packages/wlauto/workloads/antutu (where it found the .JAR file) and 3. when that didn't work, I manually installed it on the device. All three cases, wa reports it can't find the APK :(

from workload-automation.

can you attach the log file please and the full paths of the APK files on your machine.

Also by default (e.g. when running wa run antutu) WA will try to run the latest version of the workload. If you want to use an older version you have to use an agenda to specifically set this.

from workload-automation.

I'm not sure what happened. I upgraded wa and went back to the 6.0.1 APK and got a lot further. Though this time log indicates it found APK only to not find the APK later.

So updated wa back to 2.5.0:
sudo pip install --upgrade --no-deps wlauto
and confirmed from --version that it is wa 2.5.0

Put com.antutu.ABenchMark6.0.1.apk that i had used previously back to
hmlevin@hmlevin-desk:~/.workload_automation/dependencies/antutu

This time, the log file indicates that it found the APK
2016-08-22 10:35:03,446 DEBUG ResourceResolver: /home/heathermarie/.workload_automation/dependencies/antutu/com.antutu.ABenchMark6.0.1.apk

However, it's failing a little bit later, perhaps because it does not have root access to the device?
2016-08-22 10:35:09,706 ERROR Runner: Error while running antutu:
2016-08-22 10:35:09,706 ERROR Runner: <'s file com.antutu.benchmark.full-1.apk> could not be found

Attaching log
wa_output.zip

from workload-automation.

Antutu 6 also requires com.antutu.benchmark.full-1.apk this is the 3D part of the benchmark

from workload-automation.

Ok, thanks for the heads up.
So i added com.antutu.benchmark.full-1.apk as well/

But i'm seeing
2016-08-23 15:00:34,707 ERROR Runner: Timed out: adb install '/home/heathermarie/.workload_automation/dependencies/antutu/com.antutu.benchmark.full-1.apk'

in the log output. the 3d version of this file is ~75Megs and it takes about ~ 7 minutes to manually install it. do you have a recommendation on how best to change the timeout in wa to account for the delay?

Also, i'm really not clear on what changed from the original issue. I really did put the same APK in the same folder a few days later and updated wa to the latest and now it's finding it. strange.

from workload-automation.

Ok, this is what i have done to get a little further.

1. Name com.antutu.ABenchMark6.0.1.apk as com.antutu.ABenchMark.apk
   then do adb install com.antutu.ABenchMark.apk
2. Rename com.antutu.ABenchMark.apk back to com.antutu.ABenchMark6.0.1.apk and place inside of ~/.workload_automation/dependencies/antutu

*You need to do this because one it's been pushed on the device, if you leave it named com.antutu.ABenchMark6.0.1.apk then you will get this error "ERROR STDOUT: Bad argument: java.lang.IllegalArgumentException: Unknown package: com.antutu.ABenchMark". However, if you leave it named as com.antutu.ABenchMark.apk inside of ~/.workload_automation/dependencies/antutu then you will get this error:
"CRITICAL <'s apk> (version:6.0.1) could not be found"

3.Manually push the 3dmark APK (renamed to be com.antutu.benchmark.full-1.apk) since wa will timeout since it's such a big file and leave it named as com.antutu.benchmark.full-1.apk & place inside of ~/.workload_automation/dependencies/antutu

Now that i did that, i get a lot further except i'm now running into a permission error :(

ERROR from: adb shell "pm grant com.antutu.ABenchMark android.permission.ACCESS_FINE_LOCATION"
ERROR STDOUT: Operation not allowed: java.lang.SecurityException: Package com.antutu.ABenchMark has not requested permission android.permission.ACCESS_FINE_LOCATION
ERROR
ERROR STDERR:
INFO Job status was FAILED. Retrying...

from workload-automation.

Hi,
We investigated this a bit further yesterday and it turns out a bug has been introduced to WA since the 2.5 release. The version numbers listed in a workload use to just be matched with the file name and now its done by the actual apk version number too, which don't match in some cases like antutu.

let me fix up the known issues and test it on my end, once I have it working again we can test it on your setup.

from workload-automation.

Can you please try the latest WA from github and see if it solves your issues

from workload-automation.

hi,

So, I tried updating but it says it's already up to date and version is still 2.5
hmlevin@hmlevin-desk:/Automation/Antutu$ sudo -H pip install --upgrade --no-deps wlauto
Requirement already up-to-date: wlauto in /usr/local/lib/python2.7/dist-packages
hmlevin@hmlevin-desk:/Automation/Antutu/wa_output$ wa --version
wa 2.5.0

I tried running again and still get permission error (this is with workaround where I have already manually pushed the APK with the expected names as well as placing into ~/.workload_automation/dependencies/antutu with expected names as documented above)

2016-08-25 09:29:56,584 ERROR Runner: STDOUT: Operation not allowed: java.lang.SecurityException: Package com.antutu.ABenchMark has not requested permission android.permission.ACCESS_FINE_LOCATION

from workload-automation.

Sorry I should have been more clear. Can you try the latest version from github rather than from pip. We don't put out proper WA releases no where near often enough but there are always updates on git.

Sent from my iPhone

On 25 Aug 2016, at 18:16, HeatherMarie11 <[email protected]mailto:[email protected]> wrote:

hi,

So, I tried updating but it says it's already up to date and version is still 2.5
hmlevin@hmlevin-desk:/Automation/Antutu$ sudo -H pip install --upgrade --no-deps wlauto
Requirement already up-to-date: wlauto in /usr/local/lib/python2.7/dist-packages
hmlevin@hmlevin-desk:/Automation/Antutu/wa_output$ wa --version
wa 2.5.0

I tried running again and still get permission error (this is with workaround where I have already manually pushed the APK with the expected names as well as placing into ~/.workload_automation/dependencies/antutu with expected names as documented above)

2016-08-25 09:29:56,584 ERROR Runner: STDOUT: Operation not allowed: java.lang.SecurityException: Package com.antutu.ABenchMark has not requested permission android.permission.ACCESS_FINE_LOCATION

You are receiving this because you were assigned.
Reply to this email directly, view it on GitHubhttps://github.com//issues/223#issuecomment-242469646, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AFDscR9cfncTzLDac0bbLbBMVSa6xGUmks5qjc3-gaJpZM4Jo7Kn.

IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you.

from workload-automation.

hi. No problem. Thanks for your help.

Ok, I grabbed the zip from https://github.com/ARM-software/workload-automation
Unzipped it and ran the following:
python setup.py sdist
sudo -H pip install dist/wlauto-*.tar.gz

When I run "wa --version" still shows wa 2.5.0

And still seeing permission error:
ERROR Error while running antutu:
ERROR Got exit code 1
ERROR from: adb shell "pm grant com.antutu.ABenchMark android.permission.ACCESS_FINE_LOCATION"
ERROR STDOUT: Operation not allowed: java.lang.SecurityException: Package com.antutu.ABenchMark has not requested permission android.permission.ACCESS_FINE_LOCATION
ERROR
ERROR STDERR:

from workload-automation.

My device is running Android 5.1.1

from workload-automation.

Does wa require marshmallow or greater android OS?

According to http://testdroid.com/news/how-android-m-new-app-permissions-impact-on-existing-apps
it sounds like you're supposed to check Build.VERSION.CODENAME.
It seems like android.permission.ACCESS_FINE_LOCATION is new to marshmallow and thus not supported by my device.

from workload-automation.

Hi, wa only requirement is an api level > 18 which is quite old now. The issue here is specific to antutu because it had some weird issues with permissions on at least one device I tested when implementing it. Can you try adding --force to your pip command sometimes because the version number hasn't been bumped up on github it doesn't actually update.

Sent from my iPhone

On 25 Aug 2016, at 18:45, HeatherMarie11 <[email protected]mailto:[email protected]> wrote:

Does wa require marshmellow or greater android OS?

According to http://testdroid.com/news/how-android-m-new-app-permissions-impact-on-existing-apps
it sounds like you're supposed to check Build.VERSION.CODENAME.
It seems like android.permission.ACCESS_FINE_LOCATION is new to marshmellow and thus not supported by my device.

You are receiving this because you were assigned.
Reply to this email directly, view it on GitHubhttps://github.com//issues/223#issuecomment-242478626, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AFDscRGwYgoo6wwLj6mNTWSLcLaPk-UUks5qjdTLgaJpZM4Jo7Kn.

IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you.

from workload-automation.

Awe. Ok, not sure i'm doing it right, please let me know:

I tried
sudo -H pip install --force dist/wlauto-*.tar.gz
but it told me to try --upgrade

so then i tried
hmlevin@hmlevin-desk:~/Automation/Wa_Downloads/workload-automation-master$ sudo -H pip install --force --upgrade dist/wlauto-*.tar.gz

That seemed to work as we got a lot further! i see Antutu get deployed but still seeing the following errors:
hmlevin@hmlevin-desk:~/Automation/Antutu$ wa run -f antutu
INFO Removing existing output directory.
INFO Creating output directory.
INFO Initializing
INFO Running workloads
INFO Connecting to device
INFO Initializing device
INFO Initializing workloads
INFO Running workload 1 antutu (iteration 1)
INFO Setting up
INFO Executing
ERROR Error while running workload:
ERROR Timed out: adb shell '(uiautomator runtest /data/local/tmp/com.arm.wlauto.uiauto.antutu.jar -e enable_sd_tests "False" -e version "6.0.1" -e workdir "/data/local/tmp" -e times "1" -c com.arm.wlauto.uiauto.antutu.UiAutomation#runUiAutomation); echo "
ERROR $?"'
ERROR OUTPUT:
ERROR INSTRUMENTATION_STATUS: numtests=1
ERROR INSTRUMENTATION_STATUS: stream=
ERROR com.arm.wlauto.uiauto.antutu.UiAutomation:
ERROR INSTRUMENTATION_STATUS: id=UiAutomatorTestRunner
ERROR INSTRUMENTATION_STATUS: test=runUiAutomation
ERROR INSTRUMENTATION_STATUS: class=com.arm.wlauto.uiauto.antutu.UiAutomation
ERROR INSTRUMENTATION_STATUS: current=1
ERROR INSTRUMENTATION_STATUS_CODE: 1
ERROR
ERROR

from workload-automation.

Could it be there that the timeout is not long enough? I see that the test is still running - it's at 82% and counting.....

from workload-automation.

If you are running it on a particularly slow device that may be the case, antutu is quite a long benchmark. You can change the timeout in the code, the file you want to look at is wlauto/workloads/antutu/init.py. If you plan on editing code I suggest you unpack the zip file you downloaded from github and then run "sudo python setup.py develop" in the location you extracted it. This will allow you to make changes to the code and have them take effect instantly

Sent from my iPhone

On 25 Aug 2016, at 19:22, HeatherMarie11 <[email protected]mailto:[email protected]> wrote:

Could it be there that the timeout is not long enough? I see that the test is still running - it's at 82% and counting.....

You are receiving this because you were assigned.
Reply to this email directly, view it on GitHubhttps://github.com//issues/223#issuecomment-242488635, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AFDscQfGlZxFiDQkC7Tff-0afV2UcR79ks5qjduxgaJpZM4Jo7Kn.

IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you.

from workload-automation.

That was it! it worked! i modified self.run_timeout in /usr/local/lib/python2.7/dist-packages/wlauto/ workloads/antutu/init.py and was able to run & pass. Thank you!!!

from workload-automation.

Im going to close this issue now since I assume its now resolved, if this is not the case feel free to open it again.

from workload-automation.