szvsw
Edit: to be clear, I completely believe your experience - just pointing out that it might be interesting for you to actually “try” to solve it thoroughly with the tools, though it is obviously hard to do that in a fair way when you know the solution.
In an area I am more familiar with though still not my domain: when the stiffness matrix and computational linear algebra methods collide, it unlocks a world of computational structural design and analysis by commoditizing the underlying mathematics. This is a simple example, but you get the idea.
Obviously with CFD, mechanics, etc there is always massive work being done to try to unlock new computational methods, faster/parallelizable computational methods, differentiable ones, etc etc, but the general feeling is that the core physics are well modeled (NS millennium problem not withstanding) and are not lacking in predictive power for useful applications. I would have assumed that the same would be generally true for computational biology etc, so just curious to hear you elaborate more. It seems plausible to me that turning the brute force of “the models” (as in, swarms of AI compute) to work on/develop/solve/address whatever representational problems there are in the computational approximations/numerical methods you mention, particularly if that is a bottleneck to performing more extensive methodological/experimental exploration in silico to enable better exploitation/use of limited resources in wet lab.
Again, I know nothing about computational biology, just stating my intuition and curious what your take is. Probably the limits of my knowledge can be demonstrated by the fact that the only modeling methods that come to mind as being vaguely relevant would be, like,… molecular dynamics, maybe discrete element method in a weird way but doubtful, and various pop science understandings of protein folding etc.
https://canopycanopycanopy.com/contents/color-goes-electric
The Kodak “Shirley cards” and test shots are of course famous in the media theory world for how they baked notions of race and “standard” or “normal” conditions into the medium of photography. Not dissimilar from the various discussions around facial recognition from approximately 10 yr ago.
Storing data of any kind in plastic as opposed to silicon metal seems like a meaningless distinction that only comes about from imagining that there is some disembodied, ethereal and platonic notion of digital “data” which is decoupled from any physical substrate. everything is always materialized and mediated through some complex, and probably vaguely arcane, geologically extractive process in some way.
Anyways, if you write out all of the heat balance equations, you get a few W/m2 of flux on the inside wall of the home and a few W/m2 of flux on the inside faces of the fridge, assuming a typical wood frame construction in summer time and steady states all around.
So yes, of course multiplying the flux through the home’s wall by the surface area of the home results in a massive heat gain value compared to the heat gain conducted through the surface of the refrigerator, but that’s arguably precisely because of the two different volume requirements.
My point being that at least from an energy and carbon perspective, lowering the space cooling demand via more effective building envelopes or increasing the space cooling supply efficiency - eg via membrane or dessicant dehumidification, better heat pumps etc) is far more impactful on a macro scale than better refrigeration.
Granted refrigeration in a warehouse eg is really also space cooling, but I’m just making the distinction between the dT=0-25F context and the dT>25F context. If I could only choose one technology to arrive at scale to improve the efficiency, it would be for the former context.
Even though I largely agree with parts of what you wrote, if you squint your eyes enough you can kind of see an argument along the lines of “difficult to solve but easy to verify.”
Sorry to perhaps diverge into looser analogy from your excellent, focused technical unpacking of that statement, but I think another potentially interesting thread of it would be the proof of Godel’s Incompleteness Theorem, in as much as the Godel Sentence can be - kind of - thought of as an injection attack by blurring the boundaries between expressive instruction sets (code) and the medium which carries them (which can itself become data). In other words, an escape sequence attack leverages the fact that the malicious text is operated on by a program (and hijacks the program) which is itself also encoded in the same syntactic form as the attacking text, and similarly, the Godel sentence leverages the fact that the thing which it operates on and speaks about is itself also something which can operate and speak… so to speak. Or in other words, when the data becomes code, you have a problem (or if the code can be data, you have a problem), and in the Godel Sentence, that is exactly what happens.
Hopefully that made some sense… it’s been 10 years since undergrad model theory and logic proofs…
Oh, and I guess my point in raising this was just to illustrate that it really is a pretty fundamental, deep problem of formal systems more generally that you are highlighting.
“the labels are meaningless… we just have collections of complex systems that demonstrate various behaviors and properties, some in common with other systems, some behaviors that are unique to that system, sometimes through common mechanistic explanations with other systems, sometimes through wildly different mechanistic explanations, but regardless they seem to demonstrate x/y/z, and it’s useful to ask, why, how, and what the implications are of it appearing to demonstrating those properties, with both an eye towards viewing it independently of its mechanism and in light of its mechanism.”
I think it is inevitable that some - many - people will come to the conclusion that these systems have “ethics”, “morals,” etc, even if I or you personally do not think they do. Given that many people may come to that conclusion though, regardless of if the systems do or do not “actually” have such properties, I think it is useful and even necessary to ask questions like the following: “if someone engages with this system, and comes to the conclusion that it has ethics, what sort of ethics will they be likely to believe the system has? If they come to the conclusion that it has ‘world views,’ what ‘world views’ are they likely to conclude the system has, even if other people think it’s nonsensical to say it has world views?”
> The fact that a human image comes out of a mirror has no relation what so ever with the mirror's physical attributes and functional properties. It has to do just with the fact that a man is standing in front of it.
Surely this is not quite accurate - the material properties - surface roughness, reflectivity, geometry, etc - all influence the appearance of a perceptible image of a person. Look at yourself in a dirty mirror, a new mirror, a shattered mirror, a funhouse distortion mirror, a puddle of water, a window… all of these produce different images of a person with different attendant phenomenological experiences of the person seeing their reflection. To take that a step further - the entire practice of portrait photography is predicated on the idea that the collision of different technical systems with the real world can produce different semantic experiences, and it’s the photographer’s role to tune and guide the system to produce some sort of contingent affect on the person viewing the photograph at some point in the future. No, there is no “real” person in the photograph, and yet, that photograph can still convey something of person-ness, emotion, memory, etc etc. This contingent intersection of optics, chemical reactions, lighting, posture, etc all have the capacity to transmit something through time and space to another person. It’s not just a meaningless arrangement of chemical structures on paper.
> Stop feeding the LLM with data artifacts of human thought and will imediatelly stop reflecting back anything resembling a human.
But, we are feeding it with such data artifacts and will likely continue to do so for a while, and so it seems reasonable to ask what it is “reflecting” back…
The author largely takes the view that it is more productive for us to ignore any anthropomorphic representations and focus on the more concrete, material, technical systems - I’m with them there… but only to a point. The flip side of all this is of course the idea that there is still something emergent, unplanned, and mind-like. So even if it is a stochastic system following rules, clearly the rules are complex enough (to the tune of billions of operations, with signals propagating through some sort of resonant structure, if you take a more filter impulse response like view of a sequential matmuls) to result in emergent properties. Even if we (people interested in LLMs with at least some level of knowledge of ML mathematics and systems) “know better” than to believe these systems to possess morals, ethics, feelings, personalities, etc, the vast majority of people do not have any access to meaningful understanding of the mathematical, functional representation of an LLM and will not take that view, and for all intents and purposes the systems will at least seem to have those anthropomorphic properties, and so it seems like it is in fact useful to ask questions from that lens as well.
In other words, just as it’s useful to analyze and study these things as the purely technical systems they ultimately are, it is also, probably, useful to analyze them from the qualitative, ephemeral, experiential perspective that most people engage with them from, no?
I agree that it sounds stupid and incorrect, but that doesn’t necessarily mean using MCP as a metonym for MCP server.
I’ve never used other source control options besides git, and I sometimes wonder if I ever will!
Although there was support for pydantic validation in v0, now that the v1 SDK has arrived, I would definitely say that the #1 distinguishing feature (at least from a dx perspective) for anyone thinking of switching from Celery or working on a greenfield project is the type safety that comes with the first class pydantic support in v1. That is a huge boon in my opinion.
Another big boon for me was that the combo of both Python and Typescript SDKs - being able to integrate things into frontend demos without having to set up a separate Python api is great.
There are a couple rough edges around asyncio/single worker concurrency IMO - for instance, choosing between 100 workers each with capacity for 8 concurrent task runs vs 800 workers each with capacity for 1 concurrent task run. In Celery it’s a little bit easier to launch a worker node which uses separate processes to handle its concurrent tasks, whereas right now with Hatchet, that’s not possible as far as I am aware, due to how asyncio is used to handle the concurrent task runs which a single worker may be processing. If most of your work is IO bound or already asyncio friendly, this does not really affect you and you can safely use eg a worker with 8x task run capacity, but if you are CPU bound there might be some cases where you would prefer the full process isolation and feel more assured that you are maximally utilizing all your compute in a given node, and right now the best way to do that is only through horizontal scaling or 1x task workers I think. Generally, if you do not have a great mental model already of how Python handles asyncio, threads, pools, etc, the right way to think about this stuff can be a little confusing IMO, but the docs on this from Hatchet have improved. In the future though, I’d love to see an option to launch a Python worker with capacity for multiple simultaneous task runs in separate processes, even if it’s just a thin wrapper around launching separate workers under the hood.
There are also a couple of rough edges in the dashboard right now, but the team has been fixing them, and coming from celery/flower or SQS, it’s already such an improved dashboard/monitoring experience that I can’t complain!
It’s hard to describe, but there is just something fun about working with Hatchet for me, compared to Celery or my previous SQS system. Almost all of the design decision just align with what I would desire, and feel natural.
This is all just to say that batters are falling behind and there’s an argument that it hurts the on-field product from an entertainment perspective since balls in play are what we ultimately watch for - if torpedo bats make it more likely that players can bat for higher averages by barreling up the ball more consistently, it will be good for the game.
Other alternative proposals include lowering the mound (famously done in the 60s), adjusting the ball (eg lower seams, which makes it harder for pitchers to generate spin and makes the same spin rates less effective), and so on.
One good (bad?) thing is that to some extent pitchers are starting to reach a biomechanical wall, evidenced by the greatly increased rates of Tommy John surgery, though that is partly also an effect of better surgical techniques and recovery times.
Point is - it’s complicated.
It’s the single hardest skill in competitive team sports in my opinion.
> Know what the difference between hitting .250 and .300 is? It's 25 hits. 25 hits in 500 at bats is 50 points, okay? There's 6 months in a season, that's about 25 weeks. That means if you get just one extra flare a week - just one - a gorp... you get a groundball, you get a groundball with eyes... you get a dying quail, just one more dying quail a week... and you're in Yankee Stadium.
(Crash Davis)
The main other example that comes to mind is Cycling 74s Gen for Max/MSP.
Anyways, for those who are curious, Modelica was originally developed for the automotive/aerospace industries (IIRC) but is used in all sorts of fields - for me in particular, I know about it because of its use in modeling operational energy in buildings - everything from geothermal borehole fields and mesh topology district heating/cooling systems to complicated HVAC controls and more.
OpenModelica is the main open source tool for building and running modelica programs, and there are python wrappers you can use as well!
It gets posted on HN periodically -
Most recently:
> passing them means nothing about the ability of neural net-based systems to understand language, regardless of how much their authors designed them to test language understanding.
Does this implicitly suggest that it is impossible to quantitatively assess a system’s ability to understand language? (Using the term “system” in the broadest possible sense)
Not agreeing or disagreeing or asking with skepticism. Genuinely asking what your position is here, since it seems like your comment eventually leads to the conclusion that it is unknowable whether a system external to yourself understands language, or, if it is possible, then only in a purely qualitative way, or perhaps purely in a Stewart-style-pornographic-threshold-test - you’ll know it when you see it.
I don’t have any problem if that’s your position- it might even be mine! I’m more or less of the mindset that debating whether artificial systems can have certain labels attached to them revolving around words like “understanding,” “cognition,” “sentience” etc is generally unhelpful, and it’s much more interesting to just talk about what the actual practical capabilities and functionalities of such systems are on the one hand in a very concrete, observable, hopefully quantitative sense, and how it feels to interact with them in a purely qualitative sense on the other hand. Benchmarks can be useful in the former but not the latter.
Just curious where you fall. How would you recommend we approach the desire to understand whether such systems can “understand language” or “solve problems” etc etc… or are these questions useless in your view? Or only useful in as much as they (the benchmarks/tests etc) drive the development of new methodologies/innovations/measurable capabilities, but not in assigning qualitative properties to said systems?
https://github.com/whimsicalraps/Mannequins-Technical-Maps/b...
I don’t really think I was moralizing… just commenting on the funny juxtaposition of the language and the context - or on the comedy of the language specifically when not considering the whole context. I was not saying DARPA should or should not be doing this - though I’ll grant that what I wrote could be read as an implicit criticism, even though it was not my intention.
> I don't see UX experts hand-wringing about the effects of advertising when they're designing their products.
Plenty do. Plenty don’t. Similarly, plenty of machine learning engineers might choose not to work on, say, a predictive algorithm for facial recognition or a product recommender system because they don’t feel like being a part of that system. Some people don’t have that luxury, or don’t care. It’s fine either way, though I of course encourage anyone to do some reflection on the social implications of their engineering projects from time to time. Hamming, who worked on everything from the ABomb to telephones to the foundations of computer programming (and everything in between) strongly recommends this, and I agree. Working on weapons might be necessary, but you still need to reflect and make a conscious decision about it.
> It's not about "feelings" […] It comes from both directions, designing the machine to be manageable and training the human to manage in exceptional circumstances and _knowing the limits_ of both.
Of course, totally understand that. That doesn’t mean we can’t find humor in decontextualizing the language! Or in thinking about how science always must struggle with euphemism for the purposes of concision.
There is something deeply, darkly comedic (depressing?) about the qualitative language here. Primarily the way it simultaneously intersects with modern discourse around wellness, anxiety, and mental health in such a banal manner at the same time as the latent/implicit violence of action (given that the obvious subtext is operating semi-autonomous killing machines).