Comments (6)
Honestly, I do not understand why people keep trying this when clear instructions for parallelism are provided: https://github.com/exasol/pyexasol/blob/master/docs/HTTP_TRANSPORT_PARALLEL.md
threadsafety level is 1: https://github.com/exasol/pyexasol/blob/master/pyexasol/connection.py#L37-L45
Also, there is an exception for attempt to run second request from another thread: https://github.com/exasol/pyexasol/blob/master/pyexasol/connection.py#L514-L518
Connections should not be shared across multiple processes. Connections can be shared across multiple threads, but only thread can run requests in parallel.
If customer wants to run multiple queries in parallel, one connection per query is required.
If customer wants to read large data set in parallel, HTTP transport is the best bet. It requires 1 process for connection and management and any number of worker processes.
from pyexasol.
Yes, agree, but it happens again and again. That's why I thought, to state it clearly and providing guidance might help.
from pyexasol.
I'll add a page tomorrow, it's ok.
from pyexasol.
thx
from pyexasol.
@tkilias , please take a look:
https://github.com/exasol/pyexasol/blob/master/docs/PARALLELISM.md
from pyexasol.
thx, looks good.
from pyexasol.
Related Issues (20)
- Mixed type error message HOT 3
- Support for Polars HOT 8
- Migrate project setup to poetry
- export_to_file running out of memory HOT 8
- 🐞WebSocket connection isn't properly closed in case of process termination HOT 4
- Allow orjson as a serialization framework HOT 2
- update table function - pandas style HOT 1
- Mistake in documentation of import_from_iterable HOT 2
- Enabling connection encryption by default on PyExasol HOT 5
- Add job name to .github/workflows/examples.yml HOT 5
- Pyexasol with SaaS Authentication error HOT 5
- Could not connect to Exasol: [SSL: LENGTH_MISMATCH] length mismatch (_ssl.c:1129) HOT 4
- Connection from pyexasol to Exasol SaaS HOT 20
- pyexasol not raising an Exception on Exasol error HOT 10
- profiling a script with pyexasol with scalene HOT 6
- bigint and certain decimals returned as string HOT 5
- respect `no_proxy` environment variable HOT 2
- Pyexasol raises FutureWarning HOT 4
- decimal separator is wrong when Exasol Column is DOUBLE and NLS_NUMERIC_CHARACTERS = ',.' HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pyexasol.