News for hackers. Stuff that matters.
Re:Localllm lets you develop gen AI apps on local CPUs by IanCal on Thursday February 08, 2024 @05:14AM (#39300284)
A package called localllm (three l's in the middle, nice) which is focused on running models in GCP.

> run LLMs locally on CPU and memory, right within the Google Cloud Workstation

And in the code https://github.com/GoogleCloudPlatform/localllm/blob/main/qu... there's just a shebang halfway down?

    import sys

    
    def main(argv):
        pass


    if __name__ == '__main__':
        main(sys.argv)
    #!/usr/bin/env python3
This is awful. Did bard write this?

There are no comments on this comment yet.