Requirements could not deploy on Python3.10 about course-ds-base HOT 5 OPEN

Our current version of Python 3.10.0. Hence i changed some requirement.txt and updated accordingly. We will post if we find any issues..

dvc==2.8.3
joblib==1.0.1
jupyter==1.0.0
jupyter_contrib_nbextensions==0.5.1
matplotlib==3.6.1
numpy==1.23.4
pandas==1.5.1
pytest==6.2.4
python-box==5.4.1
pyyaml==5.4.1
scikit-learn==0.24.2
scipy==1.9.3
tqdm==4.64.1

from course-ds-base.

Installing collected packages: webencodings, wcwidth, voluptuous, text-unidecode, Send2Trash, pywin32, pytz, python-fsutil, pygtrie, pyasn1, pure-eval,
ply, pickleshare, phonenumbers, nanotime, mistune, mailchecker, jupyter-highlight-selected-word, ipython-genutils, iniconfig, funcy, fastjsonschema, exe
cuting, dictdiffer, commonmark, backcall, appdirs, zc.lockfile, xmltodict, widgetsnbextension, websocket-client, urllib3, typing-extensions, traitlets,
tornado, toml, tinycss2, threadpoolctl, tabulate, soupsieve, sniffio, smmap, six, shtab, shortuuid, ruamel.yaml.clib, pyzmq, pyyaml, pywinpty, python-sl
ugify, python-box, pyrsistent, pyparsing, pygments, pycparser, py, psutil, prompt-toolkit, prometheus-client, pluggy, pillow, pathspec, parso, pandocfil
ters, numpy, networkx, nest-asyncio, multidict, markupsafe, lxml, kiwisolver, jupyterlab-widgets, jupyterlab-pygments, joblib, idna, future, ftfy, fsspe
c, frozenlist, fonttools, entrypoints, dpath, distro, diskcache, defusedxml, decorator, debugpy, cycler, colorama, charset-normalizer, certifi, attrs, a
tpublic, atomicwrites, async-timeout, yarl, tqdm, terminado, scipy, ruamel.yaml, rich, requests, python-dateutil, pydot, packaging, matplotlib-inline, j
upyter-core, jsonschema, jinja2, jedi, grandalf, gitdb, flufl.lock, flatten-dict, dulwich, contourpy, configobj, cffi, bleach, beautifulsoup4, asttokens
, anyio, aiosignal, stack-data, scikit-learn, qtpy, python-benedict, pytest, pygit2, pandas, nbformat, matplotlib, jupyter-client, gitpython, argon2-cff
i-bindings, aiohttp, nbclient, ipython, argon2-cffi, aiohttp-retry, nbconvert, ipykernel, dvc, qtconsole, jupyter-server, jupyter-console, ipywidgets, n
otebook-shim, nbclassic, notebook, jupyter-latex-envs, jupyter-contrib-core, jupyter, jupyter-nbextensions-configurator, jupyter_contrib_nbextensions
Successfully installed Send2Trash-1.8.0 aiohttp-3.8.3 aiohttp-retry-2.8.3 aiosignal-1.2.0 anyio-3.6.2 appdirs-1.4.4 argon2-cffi-21.3.0 argon2-cffi-bindi
ngs-21.2.0 asttokens-2.0.8 async-timeout-4.0.2 atomicwrites-1.4.1 atpublic-3.1.1 attrs-22.1.0 backcall-0.2.0 beautifulsoup4-4.11.1 bleach-5.0.1 certifi-
2022.9.24 cffi-1.15.1 charset-normalizer-2.1.1 colorama-0.4.5 commonmark-0.9.1 configobj-5.0.6 contourpy-1.0.5 cycler-0.11.0 debugpy-1.6.3 decorator-5.1
.1 defusedxml-0.7.1 dictdiffer-0.9.0 diskcache-5.4.0 distro-1.8.0 dpath-2.0.6 dulwich-0.20.46 dvc-2.8.3 entrypoints-0.4 executing-1.1.1 fastjsonschema-2
.16.2 flatten-dict-0.4.2 flufl.lock-7.1.1 fonttools-4.38.0 frozenlist-1.3.1 fsspec-2022.10.0 ftfy-6.1.1 funcy-1.17 future-0.18.2 gitdb-4.0.9 gitpython-3
.1.29 grandalf-0.6 idna-3.4 iniconfig-1.1.1 ipykernel-6.16.1 ipython-8.5.0 ipython-genutils-0.2.0 ipywidgets-8.0.2 jedi-0.18.1 jinja2-3.1.2 joblib-1.0.1
jsonschema-4.16.0 jupyter-1.0.0 jupyter-client-7.4.3 jupyter-console-6.4.4 jupyter-contrib-core-0.4.0 jupyter-core-4.11.2 jupyter-highlight-selected-wo
rd-0.2.0 jupyter-latex-envs-1.4.6 jupyter-nbextensions-configurator-0.5.0 jupyter-server-1.21.0 jupyter_contrib_nbextensions-0.5.1 jupyterlab-pygments-0
.2.2 jupyterlab-widgets-3.0.3 kiwisolver-1.4.4 lxml-4.9.1 mailchecker-5.0.3 markupsafe-2.1.1 matplotlib-3.6.1 matplotlib-inline-0.1.6 mistune-2.0.4 mult
idict-6.0.2 nanotime-0.5.2 nbclassic-0.4.5 nbclient-0.7.0 nbconvert-7.2.2 nbformat-5.7.0 nest-asyncio-1.5.6 networkx-2.8.7 notebook-6.5.1 notebook-shim-
0.2.0 numpy-1.23.4 packaging-21.3 pandas-1.5.1 pandocfilters-1.5.0 parso-0.8.3 pathspec-0.9.0 phonenumbers-8.12.57 pickleshare-0.7.5 pillow-9.2.0 pluggy
10.1 pygments-2.13.0 pygtrie-2.5.0 pyparsing-3.0.9 pyrsistent-0.18.1 pytest-6.2.4 python-benedict-0.24.3 python-box-5.4.1 python-dateutil-2.8.2 python-f
sutil-0.7.0 python-slugify-6.1.2 pytz-2022.5 pywin32-304 pywinpty-2.0.8 pyyaml-5.4.1 pyzmq-24.0.1 qtconsole-5.3.2 qtpy-2.2.1 requests-2.28.1 rich-12.6.0
ruamel.yaml-0.17.21 ruamel.yaml.clib-0.2.7 scikit-learn-0.24.2 scipy-1.9.3 shortuuid-1.0.9 shtab-1.5.5 six-1.16.0 smmap-5.0.0 sniffio-1.3.0 soupsieve-2
.3.2.post1 stack-data-0.5.1 tabulate-0.9.0 terminado-0.16.0 text-unidecode-1.3 threadpoolctl-3.1.0 tinycss2-1.2.1 toml-0.10.2 tornado-6.2 tqdm-4.64.1 tr
aitlets-5.5.0 typing-extensions-4.4.0 urllib3-1.26.12 voluptuous-0.13.1 wcwidth-0.2.5 webencodings-0.5.1 websocket-client-1.4.1 widgetsnbextension-4.0.3
xmltodict-0.13.0 yarl-1.8.1 zc.lockfile-2.0
(dvc-venv) PS C:\Jan5-2021\DVC\course-ds-base>

from course-ds-base.

After i could deploy all required modules and trying to run the "step-1-organize-ml-project.ipynb" and it through the following message

import itertools

import joblib

import json

import matplotlib.pyplot as plt

import numpy as np

import pandas as pd

from sklearn.metrics import confusion_matrix, f1_score

from sklearn.linear_model import LogisticRegression

from sklearn.model_selection import train_test_split

ModuleNotFoundError Traceback (most recent call last)
~\AppData\Local\Temp/ipykernel_28656/688516382.py in
1 import itertools
----> 2 import joblib
3 import json
4 import matplotlib.pyplot as plt
5 import numpy as np

ModuleNotFoundError: No module named 'joblib'

In-fact, i also checked respective joblib is exist in environment.

from course-ds-base.

Hi @raviseerapu,
Please share the output of the following from your Jupyter notebook:
import sys
sys.executable

I think you're notebook is not using dvc-venv. You might need to switch the kernel.

from course-ds-base.

I use Python 3.11.6 on Mac:

joblib==1.2.0
matplotlib==3.9.0
numpy==1.23.5
pandas==2.2.2
pytest==6.2.4
python-box==5.4.1
pyyaml==6.0.1
scikit-learn==1.4.2
scipy==1.13.0
tqdm==4.63.1
dvc==3.50.2
dvc-s3==3.2.0
pygit2==1.14.1

Add these line before "from src..." in every files inside src/stages:

import sys
sys.path.append('./')

and make sure you run comand in root repo dir

from course-ds-base.