Comments (9)
Thank you, @cigrainger and @philss, for replying so quickly!!! Installing an older version of libssl sounds like the workaround suggested in one of the Ubuntu threads for other libraries that don't yet support OpenSSL 3.0. I'm currently instead playing with Tokenizers on my MBP but will try this if I must run this on Ubuntu. Hopefully Tokenizers will eventually support OpenSSL 3.0, but you're all super busy, so please feel free to close this ticket if you don't have bandwidth for it.
I was browsing through the code you've written for Axon and all your other amazing libraries and don't know how you've managed to accomplish so much so quickly. It's astonishing. Credit to Elixir's brilliant extensibility, your passion/effort to bring ML to Elixir, and the hard work of those who invented these powerful ML algorithms/tools!
from tokenizers.
Wow! Tokenizers now compiles without error on my Ubuntu machine!!! Thank you, @philss!!! I'll be pulling for Brazil against Croatia as thanks for this helpful (and clever... instead of fixing the OpenSSL 3.0 incompatibility, you entirely removed the need for OpenSSL!) solution!!! O Campeão voltou!!!
from tokenizers.
Hey! Thanks for the kind note. I'm seeing the same behaviour. I'll look into this and let you know what I find. @josevalim I seem to recall you brought this up when we were having problems with vendoring openssl? @philss is this by any chance to do with static_openssl
?
from tokenizers.
I had a go at installing old SSL but -- at least for arm64 (I was running on a Graviton2 instance) -- I was unable to get an OpenSSL 1.0 binary working with it. I actually reverted to just compiling (which worked no problem).
from tokenizers.
@JamesLavin hahaha, thank you! :D
Vamo ser hexa, Brasil!!
from tokenizers.
FWIW, I tried the exact same thing on my MBP and it ran without an error, consistent with the theory the problem is Ubuntu's use of OpenSSL 3.0, which tokenizers
isn't expecting.
from tokenizers.
@cigrainger I think the problem is that we don't use vendored SSL for this target - x86_64-unknown-linux-gnu
- we only use for MUSL targets. And the compilation is made against the older version of SSL. Thus the user may need to install an older version of libssl by hand.
I'm going to investigate more, in order to confirm my idea.
from tokenizers.
I like your chances, @philss! But still some strong teams left. I didn't see Morocco knocking off Spain, and many (including the refs???) will be pulling for Messi, so some exciting battles ahead. Regardless of the eventual outcome, I suspect Richarlison's insane goal will be the image burned into my mind from this World Cup.
from tokenizers.
@philss I've attended only three World Cup matches, all in 1994 at Stanford Stadium while I was in grad school there. One of the matches I attended was a 2-0 Brasil victory over Russia. As great as that was, Santana performed before the match!!! I still remember being surrounded by insanely happy Brasilians partying before and after the match. Joyous! https://www.paloaltoonline.com/weekly/morgue/sports/1994_Jun_17.CEREMONY.html
from tokenizers.
Related Issues (7)
- `token_to_id` and `apply` return different token_ids HOT 2
- Incorrect type definition for Tokenizers.Tokenizer.t() HOT 1
- Usage with OpenAI tokenizers? HOT 3
- Train new language models? HOT 3
- Error when applying_tokenizer from Bumblebee HOT 3
- Using regular expressions in `Tokenizers.PreTokenizer.split/3` HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tokenizers.