tree-ind / desktop-control Goto Github PK
View Code? Open in Web Editor NEWSkill For Mycroft AI to control a mouse and keyboard
License: Apache License 2.0
Skill For Mycroft AI to control a mouse and keyboard
License: Apache License 2.0
"type Mycroft is awesome" works
"press enter" not understood
"move mouse to 400 and 100" not understood
"scroll up a little" not understood
"scroll down some" not understood
"scroll down a lot" not understood
"hold space key"
Holding down the None key
An error occurred while processing a request in Desktop Control Skill
"hold w key" not understood
"release space key"
Releasing None
An error occurred while processing a request in Desktop Control Skill
"screen resolution" works
"select all" works
"select all and copy" works
For the keyboard keys in debug:
15:43:29.243 - main:handle_utterance:62 - INFO - Utterance: ['hold space key']
15:43:29.379 - mycroft.skills.core:wrapper:895 - ERROR - An error occurred while proces~~~~
Traceback (most recent call last):
File "/home/kubuntu/mycroft-core/mycroft/skills/core.py", line 886, in wrapper
handler(message)
File "/opt/mycroft/skills/desktop-control.tree-ind/init.py", line 150, in handle_~~~~
pyautogui.keyDown(key)
File "/home/kubuntu/mycroft-core/.venv/lib/python3.6/site-packages/pyautogui/init~~~~
if len(key) > 1:
TypeError: object of type 'NoneType' has no len()
I installed this in mycroft-core 20.2.4 on Ubuntu 18.04.4 LTS. I've tried all the example commands as well as simple ones others have mentioned like "type hello", and none of them work, even if I type them directly into the CLI.
hey jarvis, type hello
--> works fine
hey jarvis, press enter
Huh? I don't understand.
is this command missing somehow?
I just finished a new installation and the skill doesn't appear to be working. I have switched to the master branch and it is still not working.
How can I help debug?
installing from home.mycroft.ai and saying "download custom skill" gives the following logs in the debug console.
08:22:34.807 - main:handle_utterance:61 - INFO - Utterance: ['download custom scale']
08:22:35.746 - SkillInstallerSkill - ERROR - Msm failed: AlreadyInstalled(today-history.btotharye)
08:24:44.571 - msm.skill_entry - INFO - Downloading skill: https://github.com/TREE-Edu/desktop-control-skill
08:24:45.163 - msm.skill_entry - INFO - Installing requirements.txt for desktop-control-skill
08:24:47.092 - SkillInstallerSkill - ERROR - Msm failed: PipRequirementsException(
Pip returned code 1:
Collecting python3-xlib>=0.15 (from -r /opt/mycroft/skills/desktop-control-skill.tree-edu/requirements.txt (line 1))
Downloading https://files.pythonhosted.org/packages/ef/c6/2c5999de3bb1533521f1101e8fe56fd9c266732f4d48011c7c69b29d12ae/python3-xlib-0.15.tar.gz
(132kB)
Collecting pyautogui>=0.9.36 (from -r /opt/mycroft/skills/desktop-control-skill.tree-edu/requirements.txt
(line 2))
Downloading https://files.pythonhosted.org/packages/2e/83/89b5adbc37d1bbf7b486a2c1c00e8037e6f801e8c053c4897bb82d9510c6/PyAutoGUI-0.9.36.tar.gz
(46kB)
Complete output from command python setup.py egg_info:
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/tmp/pip-install-kb3pvh71/pyautogui/setup.py", line 6, in
version=__import__('pyautogui').__version__,
File "/tmp/pip-install-kb3pvh71/pyautogui/pyautogui/init.py", line 115, in
from . import _pyautogui_x11 as platformModule
File "/tmp/pip-install-kb3pvh71/pyautogui/pyautogui/_pyautogui_x11.py", line 7, in
from Xlib.display import Display
ModuleNotFoundError: No module named 'Xlib'
--------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-kb3pvh71/pyautogui/
)
08:24:47.256 - mycroft.skills.core:load_skill:105 - INFO - ATTEMPTING TO LOAD SKILL: desktop-
control-skill.tree-edu with ID desktop-control-skill.tree-edu
08:24:47.259 - mycroft.skills.core:load_skill:144 - ERROR - Failed to load skill: desktop-control-
skill.tree-edu
Traceback (most recent call last):
File "/home/parker/mycroft-core/mycroft/skills/core.py", line 115, in load_skill
('.py', 'rb', imp.PY_SOURCE)
File "/usr/lib/python3.6/imp.py", line 235, in load_module
return load_source(name, filename, file)
File "/usr/lib/python3.6/imp.py", line 172, in load_source
module = _load(spec)
File "", line 684, in _load
File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
File "", line 678, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/opt/mycroft/skills/desktop-control-skill.tree-edu/init.py", line 23, in
import pyautogui
ModuleNotFoundError: No module named 'pyautogui' `
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.