Comments (4)
Sync'ed with @yiheng instead of transforming the Iterator[Row] to LocalDataSet in mapPartition in step 2, we should
- Create a RDD[ByteRecord] from HDFS
- We can then transform the RDD[ByteRecord] to RDD[LabledPoint] (by applying necessary transformers through mapPartition)
from ipex-llm.
And we need to support the case that the input images have no lables
from ipex-llm.
1,2,3 points have been changed.
"Move spark.ml.DLClassifier to the utils folder" means move sparkml to utils, or just move scripts.
from ipex-llm.
We should delete the sparkml folder, and move spark.ml.DLClassifier.scala to the utils folder (just like spark.sparkExtension.scala is in the utils folder)
In addition, we need to support the case that the input images have no lables
from ipex-llm.
Related Issues (20)
- Error: llama runner process has terminated: exit status 0xc0000409 HOT 9
- update ollama 0.3.x support HOT 2
- Impact with Intel Layoffs
- Llama.cpp with IPEX-LLM is crashing HOT 7
- glm-4V run crash on Windows MTL HOT 1
- glm4:AttributeError: 'NoneType' object has no attribute 'shape' HOT 5
- ollama loading model gemma2 error:llama runner process has terminated: exit status 0xc0000409 HOT 12
- Could you help to optimize MiniCPM-V-2_6? HOT 2
- win11运行ipex报错:AMX state allocation in the OS failed HOT 3
- vllm cpu docker. Error: TypeError: invalidInputError() missing 1 required positional argument: 'errMsg' HOT 6
- vllm can‘t use oneCCL on host HOT 3
- Run InternLM2 , reports error:TypeError: internlm2_attention_forward() got an unexpected keyword argument 'cache_position' HOT 5
- [MTL][Internvl2-4B] GPU OOM for 3k input tokens HOT 1
- Please provide a method to benchmark Multimodal InternVL-4B on MTL‘s iGPU HOT 6
- Ollama already occupying port before running ./ollama serve HOT 4
- minicpm-v-2-6 can't run on A770 Ubuntu HOT 4
- Lightweight-serving support for codegeex is broken HOT 1
- MiniCPM-V-2.6 load_low_bit fails HOT 4
- GPU memory continue increase when in Deepspeed TP benchmark HOT 3
- ollama runs gemma:2b, asks a question, does not answer, and reports no error. HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ipex-llm.