Comments (12)
adamwlev
commented on August 17, 2024
5
I have the same problem on OSX 10.9.5. I followed the official installation instruction - using pip.
Adams-MacBook-Pro:predictit adamlevin$ python minnesota.py
Traceback (most recent call last):
File "minnesota.py", line 41, in <module>
session = dry.Session(base_url='http://google.com')
File "build/bdist.macosx-10.9-x86_64/egg/dryscrape/session.py", line 22, in __init__
File "build/bdist.macosx-10.9-x86_64/egg/dryscrape/driver/webkit.py", line 30, in __init__
File "/usr/local/lib/python2.7/site-packages/webkit_server-1.0-py2.7.egg/webkit_server.py", line 230, in __init__
self.conn = connection or ServerConnection()
File "/usr/local/lib/python2.7/site-packages/webkit_server-1.0-py2.7.egg/webkit_server.py", line 507, in __init__
self._sock = (server or get_default_server()).connect()
File "/usr/local/lib/python2.7/site-packages/webkit_server-1.0-py2.7.egg/webkit_server.py", line 450, in get_default_server
_default_server = Server()
File "/usr/local/lib/python2.7/site-packages/webkit_server-1.0-py2.7.egg/webkit_server.py", line 416, in __init__
stderr = subprocess.PIPE)
File "/usr/local/Cellar/python/2.7.11/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 710, in __init__
errread, err write
File "/usr/local/Cellar/python/2.7.11/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 1335, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory
from dryscrape.
sxalexander
commented on August 17, 2024
I have run into the same issue on OSX Yosemite:
Python 2.7.6 (default, Sep 9 2014, 15:04:36)
[GCC 4.2.1 Compatible Apple LLVM 6.0 (clang-600.0.39)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import dryscrape
>>> s = dryscrape.Session(base_url = 'https://google.com')
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/Users/sxalexander/.virtualenvs/ENV/src/dryscrape/dryscrape/session.py", line 18, in __init__
self.driver = driver or DefaultDriver()
File "/Users/sxalexander/.virtualenvs/ENV/src/dryscrape/dryscrape/driver/webkit.py", line 30, in __init__
super(Driver, self).__init__(**kw)
File "/Users/sxalexander/.virtualenvs/ENV/src/webkit-server/webkit_server.py", line 225, in __init__
self.conn = connection or ServerConnection()
File "/Users/sxalexander/.virtualenvs/ENV/src/webkit-server/webkit_server.py", line 444, in __init__
self._sock = (server or get_default_server()).connect()
File "/Users/sxalexander/.virtualenvs/ENV/src/webkit-server/webkit_server.py", line 423, in get_default_server
default_server = Server()
File "/Users/sxalexander/.virtualenvs/ENV/src/webkit-server/webkit_server.py", line 396, in __init__
stderr = subprocess.PIPE)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 709, in __init__
errread, errwrite)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 1326, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory
from dryscrape.
andrisp
commented on August 17, 2024
Same issue on CentOS 7 (dryscrape 0.91). webkit-server installed and running via xvfb-run.
python examples/gmail.py
Traceback (most recent call last):
File "examples/gmail.py", line 12, in <module>
sess = dryscrape.Session(base_url = 'https://mail.google.com/')
File "/usr/lib/python2.7/site-packages/dryscrape/session.py", line 18, in __init__
self.driver = driver or DefaultDriver()
File "/usr/lib/python2.7/site-packages/dryscrape/driver/webkit.py", line 30, in __init__
super(Driver, self).__init__(**kw)
File "/usr/lib/python2.7/site-packages/webkit_server-0.9-py2.7.egg/webkit_server.py", line 225, in __init__
self.conn = connection or ServerConnection()
File "/usr/lib/python2.7/site-packages/webkit_server-0.9-py2.7.egg/webkit_server.py", line 444, in __init__
self._sock = (server or get_default_server()).connect()
File "/usr/lib/python2.7/site-packages/webkit_server-0.9-py2.7.egg/webkit_server.py", line 423, in get_default_server
default_server = Server()
File "/usr/lib/python2.7/site-packages/webkit_server-0.9-py2.7.egg/webkit_server.py", line 396, in __init__
stderr = subprocess.PIPE)
File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
errread, errwrite)
File "/usr/lib64/python2.7/subprocess.py", line 1308, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory
Any suggestions on how to diagnose the problem further? Thanks!
from dryscrape.
niklasb
commented on August 17, 2024
Sorry guys, I totally forgot to comment on this earlier. Apparently the webkit-server egg does not install the thing correctly, I have to look into that.
from dryscrape.
niklasb
commented on August 17, 2024
The instructions at https://dryscrape.readthedocs.org/en/latest/installation.html however are up to date and should work fine.
from dryscrape.
jeisson1
commented on August 17, 2024
I got the same:
Python 2.7.10 (default, May 23 2015, 09:40:32) [MSC v.1500 32 bit (Intel)] on win32
Type "copyright", "credits" or "license()" for more information.
import dryscrape
search_keyword = 'dryscrape'
session = dryscrape.Session(base_url = 'http://google.com')
Traceback (most recent call last):
File "<pyshell#2>", line 1, in
session = dryscrape.Session(base_url = 'http://google.com')
File "C:\Python27\lib\site-packages\dryscrape\session.py", line 18, in init
self.driver = driver or DefaultDriver()
File "C:\Python27\lib\site-packages\dryscrape\driver\webkit.py", line 30, in init
super(Driver, self).init(**kw)
File "c:\users\jcardenas\src\webkit-server\webkit_server.py", line 225, in init
self.conn = connection or ServerConnection()
File "c:\users\jcardenas\src\webkit-server\webkit_server.py", line 444, in init
self._sock = (server or get_default_server()).connect()
File "c:\users\jcardenas\src\webkit-server\webkit_server.py", line 423, in get_default_server
default_server = Server()
File "c:\users\jcardenas\src\webkit-server\webkit_server.py", line 396, in init
stderr = subprocess.PIPE)
File "C:\Python27\lib\subprocess.py", line 710, in init
errread, errwrite)
File "C:\Python27\lib\subprocess.py", line 958, in _execute_child
startupinfo)
WindowsError: [Error 2] El sistema no puede encontrar el archivo especificado
from dryscrape.
jeisson1
commented on August 17, 2024
and in Python 3.4:
import urlparse
ImportError: No module named 'urlparse'
from dryscrape.
niklasb
commented on August 17, 2024
@jeisson1 Neither Windows nor Python 3 is officially supported. However, webkit-server should build on Windows. It's just that the included setup.py assumes that GNU make is available. Please let me know if you get it to build, so that I can include the necessary information in the docs.
from dryscrape.
niklasb
commented on August 17, 2024
The easiest way to install dryscrape now should be pip2 install dryscrape. The -e option still does not work with webkit-server, it somehow skips the build step, I'm not entirely sure why.
from dryscrape.
niklasb
commented on August 17, 2024
Please reopen if you experience similar errors with the official installation instruction, i.e. pip install or the instructions from https://dryscrape.readthedocs.org/en/latest/installation.html
from dryscrape.
marconoe
commented on August 17, 2024
Hey guys, ive got the same issue! Please help!!!
=== BUILD TARGET pleasework64 OF PROJECT pleasework64 WITH THE DEFAULT CONFIGURATION (Release) ===
Check dependencies
Validate build/Release-iphoneos/pleasework64.app
cd "/Users/marconoe/Desktop/Data Science/xcode/pleasework64"
export PATH="/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneOS.platform/Developer/usr/bin:/Applications/Xcode.app/Contents/Developer/usr/bin:/Users/marconoe/anaconda/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/Applications/Postgres.app/Contents/Versions/latest/bin"
export PRODUCT_TYPE=com.apple.product-type.application
builtin-validationUtility /Users/marconoe/Desktop/Data\ Science/xcode/pleasework64/build/Release-iphoneos/pleasework64.app -validate-for-store
** BUILD SUCCEEDED **
192-168-1-3:pleasework64 marconoe$ pip install dryscrape
Collecting dryscrape
Requirement already satisfied: lxml in /Users/marconoe/anaconda/lib/python3.5/site-packages (from dryscrape)
Collecting webkit-server>=1.0 (from dryscrape)
Using cached webkit-server-1.0.tar.gz
Requirement already satisfied: xvfbwrapper in /Users/marconoe/anaconda/lib/python3.5/site-packages (from dryscrape)
Building wheels for collected packages: webkit-server
Running setup.py bdist_wheel for webkit-server ... error
Complete output from command /Users/marconoe/anaconda/bin/python -u -c "import setuptools, tokenize;__file__='/private/var/folders/hy/td1knncs33z6qfg54_2tvd340000gn/T/pip-build-m3yr0gpz/webkit-server/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /var/folders/hy/td1knncs33z6qfg54_2tvd340000gn/T/tmpkb9o0vfypip-wheel- --python-tag cp35:
running bdist_wheel
running build
Project ERROR: Xcode not set up properly. You may need to confirm the license agreement by running /usr/bin/xcodebuild.
error: [Errno 2] No such file or directory: 'src/webkit_server'
----------------------------------------
Failed building wheel for webkit-server
Running setup.py clean for webkit-server
Failed to build webkit-server
Installing collected packages: webkit-server, dryscrape
Running setup.py install for webkit-server ... error
Complete output from command /Users/marconoe/anaconda/bin/python -u -c "import setuptools, tokenize;__file__='/private/var/folders/hy/td1knncs33z6qfg54_2tvd340000gn/T/pip-build-m3yr0gpz/webkit-server/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /var/folders/hy/td1knncs33z6qfg54_2tvd340000gn/T/pip-zw222bru-record/install-record.txt --single-version-externally-managed --compile:
running install
running build
Project ERROR: Xcode not set up properly. You may need to confirm the license agreement by running /usr/bin/xcodebuild.
error: [Errno 2] No such file or directory: 'src/webkit_server'
----------------------------------------
Command "/Users/marconoe/anaconda/bin/python -u -c "import setuptools, tokenize;__file__='/private/var/folders/hy/td1knncs33z6qfg54_2tvd340000gn/T/pip-build-m3yr0gpz/webkit-server/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /var/folders/hy/td1knncs33z6qfg54_2tvd340000gn/T/pip-zw222bru-record/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /private/var/folders/hy/td1knncs33z6qfg54_2tvd340000gn/T/pip-build-m3yr0gpz/webkit-server/```
from dryscrape.
mincaeuro
commented on August 17, 2024
Hi got the same problem:
Traceback (most recent call last): File "kataster.py", line 5, in <module> session = dryscrape.Session() File "/usr/local/lib/python2.7/dist-packages/dryscrape/session.py", line 22, in __init__ self.driver = driver or DefaultDriver() File "/usr/local/lib/python2.7/dist-packages/dryscrape/driver/webkit.py", line 30, in __init__ super(Driver, self).__init__(**kw) File "/usr/local/lib/python2.7/dist-packages/webkit_server.py", line 230, in __init__ self.conn = connection or ServerConnection() File "/usr/local/lib/python2.7/dist-packages/webkit_server.py", line 507, in __init__ self._sock = (server or get_default_server()).connect() File "/usr/local/lib/python2.7/dist-packages/webkit_server.py", line 450, in get_default_server _default_server = Server() File "/usr/local/lib/python2.7/dist-packages/webkit_server.py", line 416, in __init__ stderr = subprocess.PIPE) File "/usr/lib/python2.7/subprocess.py", line 710, in __init__ errread, errwrite) File "/usr/lib/python2.7/subprocess.py", line 1335, in _execute_child raise child_exception OSError: [Errno 2] No such file or directory
from dryscrape.
Related Issues (20)
- EndOfStreamError when visiting sites (Yelp, google business) remotely HOT 5
- HI contributor question about cookies HOT 1
- Brilliant HOT 1
- Provide instructions for Red Hat / Fedora / CentOS HOT 3
- [request] Session Closed
- dryscrape console.log HOT 3
- Windows 10 Support HOT 1
- Interacting with iframes HOT 2
- Wait javascript page to execute commands HOT 1
- Cannot install HOT 6
- Webkit_server error HOT 6
- {"class":"NodeNotAttachedError","message":"Element at 2 no longer present in the DOM"}
- follow redirects?
- How to make POST request? HOT 2
- image not found error for qt 5.5
- Cannot render page on RedHat, characters all become squares
- Can't get DOM that's generated by javascript HOT 5
- Unable to find QtWebKit on MacOS Darwin HOT 1
- Is it possible to use dryscrape with socks proxy?
- how to override default timeout parameters HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dryscrape.