Git Product home page Git Product logo

Comments (3)

kalgoritmi avatar kalgoritmi commented on August 28, 2024

What channels does your conda configuration use? If you add -c 'conda-forge' to your conda install command, it should install tiktoken without a problem.

This is not a tiktoken incompatibility issue, it is related to the unavailability of a built tiktoken package for the conda defaults channel, this is a different channel from the community driven 'conda-forge'.

If you want to test it with a new environment, run this:

conda create -n conda_forge_channel -c 'conda-forge' python=3.11.9 tiktoken

whereas, this fails:

conda create -n default_channel python=3.11.9 tiktoken

To permanently add a channel for use with all environments, use this:

conda config --add channels conda-forge

Besides these, you can see that tiktoken works with python 3.11.*, if you just create an environment, and then pip install it:

conda create -n python_3.11.9 python=3.11.9
conda deactivate && conda activate python_3.11.9
pip install tiktoken==0.7.0

This is because there is an already built wheel for CPython311 and tiktoken0.7.0 on PyPI simple for most architectures see this link, even if there was no available pre-built wheel, it would have been built from sources when running pip install.

from tiktoken.

trenton3983 avatar trenton3983 commented on August 28, 2024

This is not a tiktoken incompatibility issue, it is related to the unavailability of a built tiktoken package for the conda defaults channel.

This is not the issue.

Based on the conflict tree, it should be clear this is not an issue with the channel, because tiktoken 0.7.0 would not be present for the defaults conda channels.

Specifying a version not available in the channel would result in:

PackagesNotFoundError: The following packages are not available from current channels:

  - tiktoken=0.7.0*

Current channels:

  - defaults

In any case, my first channel in .condarc is conda-forge, which I verified.

channels:
  - conda-forge
  - defaults

from tiktoken.

hauntsaninja avatar hauntsaninja commented on August 28, 2024

I don't know very much about conda / I don't provide conda builds. tiktoken supports 3.11 and you can find 3.11 wheels on PyPI: https://pypi.org/project/tiktoken/0.7.0/#files

from tiktoken.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.