Ask HN: Machine Learning Engineers, what do you do at work?

Re:Ask HN: Machine Learning Engineers, what do you do at work? by sjducb on Sunday June 09, 2024 @03:23AM (#40622639)

You’re already managing a few hundred dependencies and their versions. Each venv roughly doubles the number of dependencies and they all have slightly different versions.

Now your 15 venvs deep, and have over 3000 different package version combinations installed. Your job is to upgrade them right now because of a level 8 CVE

[ Parent | on HN ]

Re:Ask HN: Machine Learning Engineers, what do you do at work? by fragmede on Sunday June 09, 2024 @02:27PM (#40626428)

Yeah that sucks. something like:

    for venv in $(find ~/projects/ -type d -name 'venv'); do
      (
        source ${venv}/bin/activate
        pip install --upgrade pip
        pip install --upgrade package_with_cve
        deactivate
      ) &
    done

should do the trick. Sucks that we're in that world, but let's not work any harder than we have to.

[ Parent | on HN ]

Re:Ask HN: Machine Learning Engineers, what do you do at work? by fragmede on Monday June 10, 2024 @03:54AM (#40631228)

I forgot about parallel, which would do better than spawning off all the pip install --upgrade at once.

[ Parent | on HN ]