Comments (3)
Yes, it's possible to do this in the REST call. However, you can also simply filter the result of list_storage_files
in R, eg using dplyr's filter
or arrange
-- this would probably be the simplest solution, unless you really have tons of files and pulling all the rows across the network is slowing you down.
from azurestor.
Yes I know. I just have a data lake full of small json and the retrieve of the meta data already takes quite some time. So I thought a query pushdown would be useful. Was just an idea. Not that important. Thanks.
from azurestor.
There is actually no way right now to filter a file list on the server side. Best alternative would be to use prefix
to limit the result to only files that match on the first characters of the (path/file) name.
from azurestor.
Related Issues (20)
- AzureStor::list_storage_files(cont) fails under R Server since last update HOT 43
- Setting metadata at upload time HOT 1
- Error in dyn.load when running script on the cloud using ubuntu HOT 1
- Include delete_snapshots parameter in delete_blob() and delete_blob_dir() HOT 1
- `az_storage` class `get_service_sas()` method doesn't allow passing `directory_depth`
- Support versioning for blobs HOT 1
- using token auth somewhere gets switched to access key in the pipeline HOT 2
- Using token auth breaks HOT 1
- storage_load_rds gives error due to memory while download and then read_rds works
- Error in curl::curl_fetch_memory(url, handle = handle) : Timeout was reached: HOT 1
- unused argument (azure_storage_progress_bar = progress) HOT 4
- This repo is missing important files
- Enable blob versioning with `create_blob_container()`
- Writing CSV files With Column Widths Greater Than 255 Characters to Blob Storage
- How to read Excel files in ADLS?
- Support for setting expiry on a per blob basis HOT 1
- TLS Support HOT 1
- Authenticating Using AzureGraph HOT 3
- storage_write_csv2 crashes Rstudio session
- Sourcing R code HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from azurestor.