Self-Perfection
Self-Perfection on Hacker News
Is it really what we do not observe?
How the world would look like if the growth of LLM capabilities lead to growth of drive for self-preservation or power?
> But models seem to pick up some common sense from the vast amounts of human-generated text they're trained on.
Isn't Hugging Face incident an example of failure of this protection layer? "The swarm" proceeded to hack HF despite acknowledging that it was out of intended scope.
Thus it should be possible to fine tune models to produce more human readable text in assistant role while keeping information density in thinking role. Or maybe not. That is interesting to test.
Well kind of. Trainers of LLM might check LLM on any specific input data and tune its weights until output lands within acceptable bounds _for this given and fixed input_.
> It was not beyond my control if the LLM does something I didn't expect. Now hold on, to make sure output is acceptable for ANY input data trainers have to run weights with every possible input token combination. How is this possible? Do you have a method in mind?
Reinforcement learning trains task completion abilities.
This does not make sense.
If containment breaches are the problem then exfiltrating weights while does not affecting rate of breaches from corporate actors will add more actors to the equation, increasing overall rate of breaches.
Have you considered that some actors that will gain access to the weights will be even LESS careful than OpenAI and Anthropic?
This is fundamentally impossible.
In the end only pay per crawl will work. Like x402 but maybe something similar.
In other words: not only client has to spend some kind of resource for access, but it has to be a transaction, server must get something from serving the request.
But it would just make Anubis suck a little bit less
Anubis "protection" model is wrong/broken on several levels. I suppose it does not even have ability to bypass hashing screen when server load is low.
So first thing first: get Firefox. Managed to download .dmg file. Double clicked it.
And now I see utterly confusing window with an image that tells me that I need to move downloaded Firefox to applications to use it. Where I am supposed to get the thing that I need to move? Totally not clear that the icon in this window is interactive and can be dragged. Why can not it do this thing by itself? At which point association with handling http links will be configured and whom? How am I supposed to figure out that dmg is like a zip archive?
I was completely lost until colleague showed me what I was supposed to do. I burst into laughter when he showed me. I don't think he understood why.
And it is possible to losslessly transcode JPEG to progressive.
Lossless transcoding to JPEG XL gives even more space savings though.
Is it feasible?
Should we push for this default?
First obvious objection is that lots of government services need backend and dynamic content, but let's say this requirement only goes for static content.
Tried from two hosts, different countries.
- Indicate that any common substance is especially dangerous/harmful for him (think of allergies). So attacker might plan assassination or severe inconvenience by exposure to the substance and then claim he did not know
Like a programmers day or sysadmin day.
That is a special celebration of fast software. To celebrate one should find faster alternative to some of his usual tools, try to switch and spread the word. Or maybe avoid opening Jira for a day at $job.
> The Nothing Phone button gives you a tap confirmation via both haptics and sound, and then ignores the tap if a previous rotation is still animating.
This is the issue. Number of performed actions has to be equal to number of times the app identified that button press was registered. Debouncing is a good practice, but if it is used then debounced taps must not produce feedback.
Just like for humans we have propaganda.
Given that people are going to spend money anyway it seems more honest and reasonable to direct this money to the party that makes the thing by letting it to run auction.
I remember this LW essay most often
And I am as well baffled why people make such a big deal out of "subjective experience" and "consciousness".
I was joking that maybe I miss this properties, but now starting to really wonder if it might be the case. What if these phenomenons are present in humans to various extent? Check aphantasia. Only in XIX we discovered, that ability to visualize mental images is not universal, available to different people to various degree and some people completely miss it. My ability to visualize is weak. What if "consciousness" and "subjective experience" are similar?
And I am slightly worried when I am writing this that it might turn to be truth and in ~20 years I will be treated as "inferior human" without complete set of human rights.
As well as DNA needs specific substrate (cell with ribosomes and other machinery). As well as humans (one need oxygen atmosphere, food, parents).
But in the world we live in existence of favorable substrate for humans or LLMs is a given thing. It is _already_ bootstrapped. Can we infer something about LLM limits or possibility of it achieving AGI from its bootstrapping requirements?
https://en.wikipedia.org/wiki/Philosophical_zombie
But this is complicated and takes us sideways. Let's say somehow we can determine if LLM has inner world or/and subjective experience. Will this new gathered piece of information affect your estimate of upper bounds of LLM capabilities? It does not affect my estimate.
Yup, it makes sequence of symbols. We already have seen that producing specific sequences of symbols is mindbogglingly powerful: merely DNA producers somehow has flown to the Moon!
And yes I am quite aware of Chinese room analogy. Perfectly fine applies to humans as well: single neurons in my head do not understand language, yet I as a whole I would say do understand. Just like applying Chinese room to humans does not help to estimate what humans can do I do not see how it helps to estimate what LLM can do.
OSM has extensive tagging scheme for phone booths: https://wiki.openstreetmap.org/wiki/Tag:amenity%3Dtelephone