News for hackers. Stuff that matters.

guywithabowtie

It appears that GPT 5.6 has solved another Erdos problem, the second just this week and 3rd in total. What is your opinions on this?
Motivated by the factorization inherent in the original fast multipole method and the improved fast Gauss transform we introduce a factorable form of attention that operates efficiently in high dimensions. This approach reduces the computational and memory complexity of the attention mechanism in transformers from O(N2) to O(N). In comparison to previous attempts, our work presents a linearly scaled attention mechanism that maintains the full representation of the attention matrix without compromising on sparsification and incorporates the all-to-all relationship between tokens. We explore the properties of our new attention metric and conduct tests in various standard settings. Results indicate that our attention mechanism has a robust performance and holds significant promise for diverse applications where self-attention is used.
Re:Sora: Creating video from text on Thursday February 15, 2024 @02:16PM (#39387114)
It is a future projected value of a company. You can not realize it. If you start selling stocks, they will drop at a rapid pace. The entire stock market is in a way projection of all future money the stocks will potentially make for a long time. This is not liquid cash that can be injected for any other purpose.
Re:Broadcom CEO joins Meta – AGI plans on Wednesday February 14, 2024 @04:22PM (#39375580)
Mark Zuckerberg, Founder and CEO of Meta, said, "I'm excited to share that Hock Tan and John Arnold are joining Meta's board of directors. As we focus on building AGI, having directors with deep expertise in silicon and energy infrastructure will help us execute our long term vision."
Re:GPT 4.5 metadata appears in API – Launch can happen quickly on Thursday December 14, 2023 @01:06PM (#38644733)
The API call result in the tweet shows up a user able to spot GPT4.5 model's metadata in the API. This mean that a model release is closer.
Re:SMERF: Streamable Memory Efficient Radiance Fields on Wednesday December 13, 2023 @02:36PM (#38633054)
Any plans to release the models ?
Re: on Friday November 03, 2023 @02:19PM (#38132768)
Researcher Ed Gerck claims to have cracked the world's most public key algorithm, RSA-2048, Data Breach Today reports. Gerck, a quantum computing developer and founder of Planalto Research, used a system based on quantum mechanics. Gerck's work has not yet been confirmed.
Social media platform X, formerly known as Twitter, said on Tuesday it will test a $1 annual fee under a new subscription model for posting content, replies, likes, reposts or quoting other accounts' posts, and bookmarking posts.

The purpose of introducing "Not A Bot", the new subscription model, is to combat bots and spammers.

How is the content quality ?
We introduce StreamingLLM, an efficient framework that enables LLMs trained with a finite length attention window to generalize to infinite sequence length without any fine-tuning. We show that StreamingLLM can enable Llama-2, MPT, Falcon, and Pythia to perform stable and efficient language modeling with up to 4 million tokens and more.
Re:Michael Burry shorts Major index in sizable bets on Monday August 14, 2023 @05:41PM (#37127175)
Burry and his Scion Asset Management fund bought put options (contracts giving the option to sell at a certain price) with a value of $886 million against the SPDR S&P 500 ETF Trust which tracks the S&P 500. Scion also bought put options totaling $739 million against against the Invesco QQQ Trust ETF QQQ that tracks the Nasdaq 100.

The $1.6 billion Scion spent betting against the market represents 93% of the fund's entire portfolio.

This is a reversal from the bank buying spree Scion went on in the first quarter before economic stress led to the dissolution of multiple mid-sized banks.

The S&P 500 and Nasdaq have actually had strong years so far in 2023, climbing 17% and nearly 40%, respectively.

In the video, it says above 110K and not below, I got confused as well. I will add that a lot of people are deleting retweeting this. May be there is something more to it.
The new study showed that AOH1996 kills cancer cells by disrupting the cell reproductive cycle, specifically inhibiting transcription-replication conflicts—a phenomenon that occurs when the cell machinery responsible for genome duplication and gene expression literally run into each other on the spot in the genome. This leads to DNA replication stress, genomic instability and, ultimately, can give rise to cancer.

By targeting mutated PCNA with AOH1996, the researchers kept cells with damaged DNA from dividing while leaving normal cells intact, as shown by studies of the drug’s effects on healthy stem cells

Do you also have results of GPT4 somewhere? or text-davinci-003-turbo
Re:Covid vaccine in 2019? Senate report on Covid on Tuesday April 18, 2023 @10:11PM (#35623435)
Ten things we learned from the Senate report on Covid in China

US Senate Committee reveals China may have made vaccines before telling the world there was a dangerous virus in the country + others

Re:Self Compression done by GPT to extend context length on Sunday April 16, 2023 @05:31PM (#35594461)
This new trick let's anyone compress the prompts by 5-10 times in order to continue on the same chat thread for a very extended period of time. The original author is calling it "Shogtongue". I would love you all to check it.
What would be the future plan here? Any hosted commercial offerings? I am asking to understand whether one could use and depend upon it for few years.
It has special optimizations for reducing cold start.
Firecracker is the VM powering AWS Lambda, it is maintained by Amazon. It is pretty decent and popular in certain areas. I believe Fly.io is using them behind them too.

Older »