vans554
Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup
on Wednesday July 19, 2023 @05:46PM (#36793916)
Pretty interesting. Using nightly + cu121 im getting 8.18 it/s, another 5% improvement vs 7.78 that cu118 gave.
Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup
on Wednesday July 19, 2023 @10:55AM (#36787474)
I accidentally stumbled upon this and did not expect such a speedup. It seems anything less than cu118 does not properly support the RTX4090 (or H100).
Bumping to cuda12.2 with pytorch2.0.1+cu118 made my SDXL go 50% faster and ESRGAN 80% faster on the 4090.
Karlo Diffusion Endpoint
Re:Karlo Diffusion Endpoint
on Friday December 23, 2022 @08:12PM (#34112715)
I put Karlo diffusion by Kakao running as an inference endpoint on GPUX. Karlo Diffusion is more controllable, similar to Dalle-2.
Make some images here https://explorer.gpux.ai/inference/gpux/karlo
Re:FILM: Frame Interpolation for Large Motion
on Friday December 23, 2022 @04:23PM (#34110781)
Thanks.
Re:FILM: Frame Interpolation for Large Motion
on Tuesday December 20, 2022 @10:59AM (#34067685)
Yea but this is irrelevent unless you implying that FILM is better quality while nvfruc is lower quality but faster so applicable for realtime?
if nvfruc is better quality + faster then the comparison is that nvfruc is better.
Re:FILM: Frame Interpolation for Large Motion
on Monday December 19, 2022 @07:16PM (#34059786)
very cool how does this compare to NVIDIA nvfruc?
https://docs.nvidia.com/video-technologies/optical-flow-sdk/...
Re:AI breakthrough ChatGPT raises alarm over student cheating
on Monday December 19, 2022 @06:37PM (#34059453)
People still go to traditional-school?
Re:A pure Rust implementation of WebRTC
on Monday December 19, 2022 @06:32PM (#34059402)
Much needed thank you for doing gods work.
Show HN: GPUX, scalable inference for AI Models
https://explorer.gpux.ai/inference
I found that using models was too complex and it needed a simple interface (instead of documentation); while working on it, a few other companies created the same exact thing lol.Here it is anyways, HTTP GET(able) endpoints for StableDiffusion and other.Wondering your thoughts?
Re:Why Domain Driven Design?
on Friday November 25, 2022 @01:41PM (#33745453)
DDD is just microservices without head of line blocking not sure why everyone hates it. Instead of having 5 microservices you just build an umbrella app exposing the same 5 API. Calls into the umbrella are now at microsecond speed vs 10s of milliseconds in most (run of the mill publicly available) clouds.
Re:Show HN: Baldur's Gate 2 online demo reimplemented in WASM
on Monday May 31, 2021 @04:29PM (#27347776)
Mouse lag needs to be fixed.
Re:Show HN: VRland – create and host 3D/VR spaces online in WebGL/WebXR
on Monday May 24, 2021 @01:45PM (#27267425)
Would be cool to move realworld assets into virtual worlds, and vice versa.