Tokenizers don't work with OpenSSL 3.0??? about tokenizers HOT 9 CLOSED

Thank you, @cigrainger and @philss, for replying so quickly!!! Installing an older version of libssl sounds like the workaround suggested in one of the Ubuntu threads for other libraries that don't yet support OpenSSL 3.0. I'm currently instead playing with Tokenizers on my MBP but will try this if I must run this on Ubuntu. Hopefully Tokenizers will eventually support OpenSSL 3.0, but you're all super busy, so please feel free to close this ticket if you don't have bandwidth for it.

I was browsing through the code you've written for Axon and all your other amazing libraries and don't know how you've managed to accomplish so much so quickly. It's astonishing. Credit to Elixir's brilliant extensibility, your passion/effort to bring ML to Elixir, and the hard work of those who invented these powerful ML algorithms/tools!

from tokenizers.

Wow! Tokenizers now compiles without error on my Ubuntu machine!!! Thank you, @philss!!! I'll be pulling for Brazil against Croatia as thanks for this helpful (and clever... instead of fixing the OpenSSL 3.0 incompatibility, you entirely removed the need for OpenSSL!) solution!!! O Campeão voltou!!!

from tokenizers.

Hey! Thanks for the kind note. I'm seeing the same behaviour. I'll look into this and let you know what I find. @josevalim I seem to recall you brought this up when we were having problems with vendoring openssl? @philss is this by any chance to do with static_openssl?

from tokenizers.

I had a go at installing old SSL but -- at least for arm64 (I was running on a Graviton2 instance) -- I was unable to get an OpenSSL 1.0 binary working with it. I actually reverted to just compiling (which worked no problem).

from tokenizers.

@JamesLavin hahaha, thank you! :D
Vamo ser hexa, Brasil!!

from tokenizers.

FWIW, I tried the exact same thing on my MBP and it ran without an error, consistent with the theory the problem is Ubuntu's use of OpenSSL 3.0, which tokenizers isn't expecting.

from tokenizers.

@cigrainger I think the problem is that we don't use vendored SSL for this target - x86_64-unknown-linux-gnu - we only use for MUSL targets. And the compilation is made against the older version of SSL. Thus the user may need to install an older version of libssl by hand.

I'm going to investigate more, in order to confirm my idea.

from tokenizers.

I like your chances, @philss! But still some strong teams left. I didn't see Morocco knocking off Spain, and many (including the refs???) will be pulling for Messi, so some exciting battles ahead. Regardless of the eventual outcome, I suspect Richarlison's insane goal will be the image burned into my mind from this World Cup.

from tokenizers.

@philss I've attended only three World Cup matches, all in 1994 at Stanford Stadium while I was in grad school there. One of the matches I attended was a 2-0 Brasil victory over Russia. As great as that was, Santana performed before the match!!! I still remember being surrounded by insanely happy Brasilians partying before and after the match. Joyous! https://www.paloaltoonline.com/weekly/morgue/sports/1994_Jun_17.CEREMONY.html

from tokenizers.