Stable Diffusion in pure C/C++

Re:Stable Diffusion in pure C/C++ by waynecochran on Saturday August 19, 2023 @01:34PM (#37191109)

Everyone has their own way to do this. Every step is broken by some unfamiliar dependency that requires special arcane knowledge to fix. Part of me is a grumpy old man that doesn’t gravitate to the shiny new tools that come out every week that the younger devs keep up with :)

[ Parent | on HN ]

Re:Stable Diffusion in pure C/C++ by pdntspa on Saturday August 19, 2023 @01:36PM (#37191124)

pip and venv are neither shiny nor new, it's the standard way of doing things for a while. I am an outsider to python and am incredibly thankful for this standardization, because i agree getting python env set up correctly before venv was a huge pain

If your guys arent on this I'd suggest you get them on it, it dramatically simplifies setup

[ Parent | on HN ]

Re:Stable Diffusion in pure C/C++ by waynecochran on Saturday August 19, 2023 @01:53PM (#37191320)

Here is a tiny excerpt try to get dvc to work just so I could get the training weights for deployment ... remember I don't develop much w Python...

    $ dvc pull
    Command 'dvc' not found, but can be installed with:
    sudo snap install dvc

    $ sudo snap install dvc
    error: This revision of snap "dvc" was published using classic confinement and thus may perform
    arbitrary system changes outside of the security sandbox that snaps are usually confined to,
    which may put your system at risk.

    If you understand and want to proceed repeat the command including --classic.

 ok I get dvc installed somehow -- don't remember. Time to get the weights...

    $ python3 -m dvc pull
    ERROR: unexpected error - Forbidden: An error occurred (403) when calling the HeadObject operation: Forbidden            

    Having any troubles? Hit us up at https://dvc.org/support, we are always happy to help!

Finally I just have my colleague manually copy the weights. This kind of thing went for hours.

[ Parent | on HN ]

Re:Stable Diffusion in pure C/C++ by pdntspa on Saturday August 19, 2023 @02:14PM (#37191515)

Researchers are notorious for writing bad code

What even is dvc

[ Parent | on HN ]

Re:Stable Diffusion in pure C/C++ by waynecochran on Saturday August 19, 2023 @02:26PM (#37191622)

I think dvc is like git for large binary files. You need someway to manage your NN weights -- what are other methods?

[ Parent | on HN ]

Re:Stable Diffusion in pure C/C++ by pdntspa on Saturday August 19, 2023 @03:38PM (#37192311)

git lfs is what everyone is using, HF in particular

[ Parent | on HN ]

Re:Stable Diffusion in pure C/C++ by efiop on Saturday August 19, 2023 @04:54PM (#37193084)

Hey, DVC maintainer here.

Thanks for giving DVC a try!

With snap, you need to use `--classic` flag, as noted in https://dvc.org/doc/install/linux#install-with-snap Unfortunately that's just how snap works for us there :(

Regarding the pull error, it simply looks like you don't have some credentials set up. See https://dvc.org/doc/user-guide/data-management/remote-storag... Still, the error could be better, so that's on us.

Feel free to ping us in discord (see invite link in https://dvc.org/support). I'm @ruslan there. We'll be happy to help.

Thanks, Ruslan

[ Parent | on HN ]

Re:Stable Diffusion in pure C/C++ by waynecochran on Sunday August 20, 2023 @09:24AM (#37198908)

Thanks… i know my colleague uses it a lot. I generally use his models and don’t do much ML development yet. At some point I need to properly learn all of this. It seems ML tools are only for developers not for those who simply want to deploy and use the resulting NN.

[ Parent | on HN ]