News for hackers. Stuff that matters.
Re:How to Use the Foreign Function API in Java 22 to Call C ... by marginalia_nu on Wednesday May 08, 2024 @01:32PM (#40300783)
Oh, does this actually work?

I was on the assumption that it was dynamically linking the libarary with the OS dynamic linker, which in no OS I'm aware of is capable of loading libraries inside of zip files.

Not sure where I got that notion. Maybe I was overthinking this.

Re:How to Use the Foreign Function API in Java 22 to Call C ... by brabel on Wednesday May 08, 2024 @04:15PM (#40302373)
I remember using Sqlite Java and not having to install sqlite on the image. Then I looked inside the Sqlite-java's jar and they just packed the sqlite binaries for the different OSs in the jar!!
Re:How to Use the Foreign Function API in Java 22 to Call C ... by DannyB2 on Wednesday May 08, 2024 @04:32PM (#40302495)
I once (2016 ish) used a serial-port library for Java. Needed to be cross platform desktop app for Linux, Windows and Mac (in that order, all on x86/64). And it was. I have forgotten the name of the library project I included, but it included DLL binaries for the platforms we were targeting.
Re:How to Use the Foreign Function API in Java 22 to Call C ... by dehrmann on Thursday May 09, 2024 @01:38AM (#40305579)
Not sure if this is still the case, but one of the Java Sqlite driver used something called NestedVM to run Sqlite in the JVM when a native library wasn't available. It worked by cross-compiling the code to mips, then transpiling the mips assembly to Java byte code. I can't remember if it bridged system calls or libc calls to Java for things like file IO.
Re:How to Use the Foreign Function API in Java 22 to Call C ... by KptMarchewa on Thursday May 09, 2024 @05:55AM (#40306658)
That's a common solution. I do the same.
Re:How to Use the Foreign Function API in Java 22 to Call C ... by zten on Wednesday May 08, 2024 @01:36PM (#40300836)
Yes. Check out a library like zstd-jni. You'll find native libraries inside it. It'll load from the classpath first, and then ask the OS linker to find it.
Re:How to Use the Foreign Function API in Java 22 to Call C ... by maksut on Wednesday May 08, 2024 @02:03PM (#40301137)
I'd like to learn how they do it. Because last time I've looked at this, the suggested solution was to copy the binaries from claspath (eg: the jar) into a temporary folder then load it from there. It feels icky :)
Re:How to Use the Foreign Function API in Java 22 to Call C ... by zten on Wednesday May 08, 2024 @03:39PM (#40302053)
Yep, you're right, they do exactly that. Apologies for the confusion.

Decompiled class file:

    try {
        var4 = File.createTempFile("libzstd-jni-1.5.0-4", "." + libExtension(), var0);
        var4.deleteOnExit();
Re:How to Use the Foreign Function API in Java 22 to Call C ... by sedro on Wednesday May 08, 2024 @08:42PM (#40304154)
This wouldn't work on Windows, because you can't delete a DLL while it's in use
Re:How to Use the Foreign Function API in Java 22 to Call C ... by BenjiWiebe on Wednesday May 08, 2024 @09:57PM (#40304544)
Couldn't you: Extract DLL Load DLL Unload DLL Delete DLL ?

Though in the example given, I do see your point now. You'd have to make sure the DLL was unloaded before the delete-on-exit happened.

Re:How to Use the Foreign Function API in Java 22 to Call C ... by sedro on Wednesday May 08, 2024 @11:18PM (#40304991)
According to JNA it's not safe to unload the DLL:

https://github.com/java-native-access/jna/blob/40f0a1249b5ad...

  Do NOT force the class loader to unload the native library, since
  that introduces issues with cleaning up any extant JNA bits
  (e.g. Memory) which may still need use of the library before shutdown.
Following the blame back to 2011, they did unload DLLs before https://github.com/java-native-access/jna/commit/71de662675b...

  Remove any automatically unpacked native library.  Forcing the class
  loader to unload it first is only required on Windows, since the
  temporary native library is still "in use" and can't be deleted until
  the native library is removed from its class loader.  Any deferred
  execution we might install at this point would prevent the Native
  class and its class loader from being GC'd, so we instead force 
  the native library unload just a little bit prematurely.
Users reported occasional access violation errors during shutdown.
Re:How to Use the Foreign Function API in Java 22 to Call C ... by tadfisher on Wednesday May 08, 2024 @10:58PM (#40304881)
You can install a shutdown hook to do cleanup like this.

    Runtime.getRuntime().addShutdownHook(...)
Re:How to Use the Foreign Function API in Java 22 to Call C ... by sedro on Wednesday May 08, 2024 @11:22PM (#40305010)
That's how java.io.File#deleteOnExit works under the hood. The DLL is still loaded at that point and can't be deleted.
Re:How to Use the Foreign Function API in Java 22 to Call C ... by tadfisher on Thursday May 09, 2024 @03:51PM (#40312275)
Ah, looking through the docs [1]; you have to use your own ClassLoader (so it can be garbage-collected), and statically-link with a JNI library which is unloaded when the ClassLoader is garbage-collected.

1: https://docs.oracle.com/en/java/javase/22/docs/specs/jni/inv...

Re:How to Use the Foreign Function API in Java 22 to Call C ... by electrum on Thursday May 09, 2024 @12:30AM (#40305316)
You might be able to use FILE_FLAG_DELETE_ON_CLOSE, but this would likely require calling the Windows API functions directly.
Re:How to Use the Foreign Function API in Java 22 to Call C ... by zten on Thursday May 09, 2024 @12:27PM (#40309870)
Hmm, interesting. They do have DLLs in the JAR...
Re:How to Use the Foreign Function API in Java 22 to Call C ... by renewiltord on Wednesday May 08, 2024 @02:26PM (#40301387)
EDIT: Disregard. I am wrong. Original below.

You can just load as a resource. We do this internally since much of network stack is C. But we use JNI because code is older than Java 22.

Re:How to Use the Foreign Function API in Java 22 to Call C ... by maksut on Wednesday May 08, 2024 @02:55PM (#40301671)
You made me search it again. And still I don't see how that's possible. `Runtime.load` requires a regular file with an absolute path[0].

Stackoverflow is full of "copy it into a temp file" solutions. ChatGPT keeps saying "sorry" but still insists on copying it into a temp file :)

[0] - https://docs.oracle.com/en%2Fjava%2Fjavase%2F22%2Fdocs%2Fapi...

Re:How to Use the Foreign Function API in Java 22 to Call C ... by renewiltord on Wednesday May 08, 2024 @03:03PM (#40301749)
Embarrassing of me to give you wrong answer. I went and checked my old code and:

     new FileOutputStream(tmpFile)
Apologies.
Re:How to Use the Foreign Function API in Java 22 to Call C ... by marginalia_nu on Wednesday May 08, 2024 @01:41PM (#40300891)
Sounds promising.

I have some extremely unwieldy off-heap operations currently implemented in Java (like quicksort for 128 bit records) that would be very nice to offload as FFI calls to the corresponding a single-line C++ function.

Re:How to Use the Foreign Function API in Java 22 to Call C ... by neonsunset on Wednesday May 08, 2024 @02:10PM (#40301219)
Why not give C# a try instead? It has everything you ask for and then some.
Re:How to Use the Foreign Function API in Java 22 to Call C ... by neonsunset on Thursday May 09, 2024 @01:47AM (#40305619)
Wow, you all are sure mad enough to go out of your way and downvote my comments elsewhere.

Stay in the swamp :)

Re:How to Use the Foreign Function API in Java 22 to Call C ... by coldtea on Thursday May 09, 2024 @05:17AM (#40306496)
Because "some inconvenience/unmet requirement" from a language is not an invitation to "throw out the whole platform and your existing code and tooling, and learn/adopt/use an entirely different, single-vendor platform".

Except if we're talking about some college student or hobbyist picking their first language and exploring the language space...

Re:How to Use the Foreign Function API in Java 22 to Call C ... by imtringued on Thursday May 09, 2024 @10:02AM (#40308341)
He would still have to call out to the C++ function.
Re:How to Use the Foreign Function API in Java 22 to Call C ... by neonsunset on Thursday May 09, 2024 @10:46AM (#40308773)
Assuming it is "sort for 128bit records", that's something C# does really well - writing optimized code with structs / Vector128<T> / pointer arithmetic when really needed without going through FFI and having to maintain separate build step and project parts for a different platform.

But even if it was needed, such records can be commonly represented by the same structs both at C#'s and C++'s sides without overhead.

An array of such could be passed as is as a pointer, or vice versa - a buffer of struts allocated in C/C++ can be wrapped in a Span<Record128> and transparently interact with the rest of standard library without having to touch unsafe (aside from eventually freeing it, should that be necessary).

Re:How to Use the Foreign Function API in Java 22 to Call C ... by saagarjha on Wednesday May 08, 2024 @08:03PM (#40303955)
Android knows how to do this, actually.