News for hackers. Stuff that matters.

akkishore

Re:Reproduce GPT-2 (124M) in llm.c in 90 minutes for $20 on Wednesday May 29, 2024 @09:11AM (#40511616)
Hi Andrej,

Huge fan of all the work you do. Wanted to understand something fundamental and whom better to ask than you: Whats so special about the transformer architecture that its able to predict the next token so beautifully understanding all the intricate previous token relationships? I understand Attention but what so special about this architecture that no other architectures are able to "attend" appropriately to previous tokens? Being a CS guy, its really hard for me to fathom that we have not yet created another architecture which can perform similarly.

Re:AWS us-east-2 outage on Thursday July 28, 2022 @10:56PM (#32272675)
But technical debt bites you in every new feature by slowing new code addition.
Checkout MultiSSH for administering multiple machines over SSH: https://multissh.dev/
This is awesome. How does this compare with Firecracker - https://github.com/firecracker-microvm/firecracker

Why only TCP is available? Network stack needs to be implemented?

Can we create a view over multiple parquet files?
From the white paper: "If additional shadow headers are used, their suggested locations are (where possible) at the sectors starting at offsets 128MiB, 128GiB, and 128TiB"

Is such repetition of header (in a supposedly random-wiped disk) not suggestive of existence of a PUREE partition? This can be figured by scanning the entire disk.

Any thoughts how to enforce consistent dev environment among the team mates?

Ask HN: While developing, do you run all the dependent services on your machine?

Development requires running many dependent services, like databases, caching servers, queues, other dependent (micro) services etc. Do you run them on your machine? Or you use other server infrastructure to run them while only running the specific service you are developing on your machine? How do you enforce consistent dev environment across your team mates?

( Read More... | 13 comments | 11 points | on HN )
Hahaha, will take care to remove all spurious public pages.
Sure, will look at Protonmail and improve the website communication.
Sorry for this. We are adding more pages as we go forward. Request you to please try out the product and share any feedback.
We will soon add more pages explaining how we are doing the encryption. Few details are already mentioned in the homepage as of now. Essentially we take every 64 kb of your file and encrypt it with AES-256 encryption algorithm with GCM authentication using your VyomKey as the encryption key. We haven't rolled out any new encryption algo. This is just a start, will add more pages as we go forward. Our main USP is that we use an encryption key of user's own choice - the VyomKey - to encrypt the files which is not there in any other competing product.
Thanks Nicolas for the wishes. We will do our best.
Thanks bigiain for the suggestion. Just mentioned so since Dropbox is in the news. We are essentially an alternative to Dropbox, Google Drive, Microsoft OneDrive.
We will be adding lot more information in the coming days. We will publish a white paper on the backend tech to be completely transparent on how data is being handled. Please bear with us. Please do signup so we can send you early invite.
As mentioned in the other comment, cloud may be involved if personal machines are behind firewall/NAT (all data to cloud will be encrypted and passed through with no persistence what so ever). Although the product tries to punch holes with UPnP, it may not always be successful. The other reason is for us to make money. Any alternate monetisation ideas?
The product enables you create a seamless personal cloud among your own computers. Although there are no servers involved for storing the data, there are servers involved for enabling seamless connection between your computers when they are behind firewall/NAT.

Older »