News for hackers. Stuff that matters.
Re:Rust: 128 bit integers preparing to be released by pkulak on Saturday December 03, 2016 @11:26PM (#13098784)
GUIDs are usually 128 bits. So are IPv6 addresses. Could be nice to store them in a single, native type? Probably no easier than a byte array though...
Re:Rust: 128 bit integers preparing to be released by w8rbt on Sunday December 04, 2016 @10:42AM (#13100270)
Then you could do this:

    ping6 42540577535212633203815888880477462122
Like you can do this:

    ping 2158835347
    PING 2158835347 (128.173.54.147) 56(84) bytes of data.
    64 bytes from 128.173.54.147: icmp_seq=1 ttl=52 time=20.4 ms
    64 bytes from 128.173.54.147: icmp_seq=2 ttl=52 time=20.5 ms
Re:Rust: 128 bit integers preparing to be released by PeCaN on Saturday December 03, 2016 @11:54PM (#13098839)
Neither one is used like an integer though. As in, you don't really add GUIDs together¹, so there's no real benefit over a byte array or struct.

1. I guess having bit mask operations for IPv6 addresses could be useful.

Re:Rust: 128 bit integers preparing to be released by XorNot on Sunday December 04, 2016 @12:46AM (#13098933)
Avoiding pointers to arrays is nice.

This is the big annoyance in Golang with it's net.IP type - it's `type IP []byte`, which means you can write ip1 == ip2 and you can't pass by value easily, nor use it as a map key.

I've ended up inventing my own type for that a lot of the time as a struct wit static fields, since those you can copy around and do 1:1 comparisons.

Though to be honest I'd be super happy if there was a drop-in varint type, or you could trivially have the compiler calculate instructions for a arbitrary fixed size ints.

Re:Rust: 128 bit integers preparing to be released by dbaupp on Sunday December 04, 2016 @12:54AM (#13098951)
Rust offers non-allocating fixed-sized arrays, so a GUID could be a (wrapper around) [u8; 16] and an IPv6 address could be [u16; 8].
Re:Rust: 128 bit integers preparing to be released by steveklabnik on Sunday December 04, 2016 @01:03AM (#13098967)
That's exactly how the UUID crate implements them: https://github.com/rust-lang-nursery/uuid/blob/master/src/li...
Re:Rust: 128 bit integers preparing to be released by barsonme on Sunday December 04, 2016 @01:18AM (#13099000)
So does Go, so a net.IP could be [16]byte or [4]byte, but I'm sure you can see the obvious problems that might occur there (with having two separate IP types).

Most UUID libraries I've seen and written use [16]byte as the concrete UUID type.

Re:Rust: 128 bit integers preparing to be released by dbaupp on Sunday December 04, 2016 @01:25AM (#13099020)
I don't see the obvious problem (fwiw, I really dislike such rhetorical devices): presumably net.IP could a struct that contains a [16]byte and an isV4 flag.
Re:Rust: 128 bit integers preparing to be released by barsonme on Sunday December 04, 2016 @02:24AM (#13099151)
The problem is [16]byte would always be wasting 12 bytes for IPv4 addresses if you only used one type for both. So, two types must be made which requires extra code and doesn't allow for == comparison which is what OP (GP? whomever...) was complaining about not being able to do since net.IP is []byte.

Sorry for the rhetorical device.

Re:Rust: 128 bit integers preparing to be released by ben0x539 on Sunday December 04, 2016 @03:50AM (#13099319)
Isn't the indirection overhead of a []byte more expensive than a spare 12 inline bytes?
Re:Rust: 128 bit integers preparing to be released by dbaupp on Sunday December 04, 2016 @12:04PM (#13100618)
Yes, and a []byte is even going to have at least as much inline overhead: it stores 24 bytes (length, capacity, pointer), and of course plus the 4 bytes of actual data. Even on a 32-bit platform, the []byte inline storage is 12 bytes.
Re:Rust: 128 bit integers preparing to be released by int_19h on Sunday December 04, 2016 @02:18AM (#13099130)
I think the point was that when it's a mere alias, you can end up passing an array of the right size and type that is not an IP address.
Re:Rust: 128 bit integers preparing to be released by LeonidBugaev on Sunday December 04, 2016 @03:06AM (#13099241)
If you are using default library IPv4 addresses stores as [16]byte: https://golang.org/src/net/ip.go
Re:Rust: 128 bit integers preparing to be released by daenney on Sunday December 04, 2016 @04:50AM (#13099428)
I don't think that's what the Godoc says. The IP type is defined as []byte

  type IP []byte
That is not the same as [16]byte.

  // Note that in this documentation, referring to an
  // IP address as an IPv4 address or an IPv6 address
  // is a semantic property of the address, not just the
  // length of the byte slice: a 16-byte slice can still
  // be an IPv4 address.
What I believe that comment is saying is that something that is [16]byte can still be an IPv4 address, but that doesn't mean that all IPv4 addresses are stored as [16]byte. At least that would be my interpretation based on the comment above it:

  // An IP is a single IP address, a slice of bytes.
  // Functions in this package accept either 4-byte (IPv4)
  // or 16-byte (IPv6) slices as input.
Re:Rust: 128 bit integers preparing to be released by eropple on Sunday December 04, 2016 @04:44AM (#13099407)
IP addresses are used like integers all the time. Ask your friendly neighborhood sysadmin how a network mask works.

(Maybe you want to foreach over an array every time you want to apply one. I'd rather not.)

Re:Rust: 128 bit integers preparing to be released by CuriousSkeptic on Sunday December 04, 2016 @06:19AM (#13099608)
I realize integer has rather specific meaning in this context. But really, your comment just highlights the issue.

In my world integer is a mathematical construct with no particular representation, making things like bitmasks and or shifts nonsensical.

If you really want to work with fixed length bitstrings why not just have a type for that? Operating on a string of 128-bits should be valid on all such bitstrings no matter wether those represent a number or a string of code points.

And equally operations on integers should not care about particular bitstrings representations of the number in question.

Re:Rust: 128 bit integers preparing to be released by eropple on Sunday December 04, 2016 @06:36AM (#13099654)
> In my world integer is a mathematical construct with no particular representation

Your world doesn't map to the reality of silicon and registers, whereas Rust does. As it happens, you can be fixed much more easily than the whole of modern computing.

> If you really want to work with fixed length bitstrings why not just have a type for that?

I don't. I want to work with integers. An IPv6 address is not the hex format that you read--it is a 128-bit integer. You can go read RFC 2460 if you don't believe me, but it's true. It is an integer that I can add and subtract from; I don't add 1 to an octet of an IP address and then do a bunch of carries if I want the next IP address in my network, I add 1 to the IP address. I don't perform some magic operation to determine what a subnet looks like, I bitand the integer. They are inescapably based on the representation used both by my computer and by my network hardware. (As is the performance of both my network hardware and yours. There's a reason that your router doesn't use BCD or whatever.)

There are programming languages that do not represent the underlying system. They are, for the most part, bad at dealing with the kinds of problems Rust is tailored to effectively represent. You can use those. It's pretty presumptuous to suggest that languages designed for lower-level problems accommodate your peculiarity.

Re:Rust: 128 bit integers preparing to be released by fnj on Sunday December 04, 2016 @06:43AM (#13099665)
Not really. They are never added, subtracted, multiplied, or divided. They are never compared for greater-than or less-than. Possibly they are compared for equality.

About the only mathematical operations I can think of which are ever done to them are bitwise-anding, bitwise-inclusive-oring, and testing for zero (and, as mentioned, equality).

Re:Rust: 128 bit integers preparing to be released by eropple on Sunday December 04, 2016 @06:44AM (#13099670)
Yes, really. I mean, I add to IP addresses regularly. How else do you enumerate a subnet (like, what do you think nmap does)? How else do you place, say, twelve machines at 172.17.0.120 through .131? If you're doing string concatenation, you are screwing up. Perhaps it's not enough of a screwup to impact what you do--but definitely wrong enough to impact what I do unless I were to do a lot of extra work in modeling an IP address just for the sake of somebody else's spherical cow of uniform density. (And I do mean work I'd have to do--the lack of a decent IP addressing library on the JVM is a recurring pain in my ass, but since they're just integers...)

If you have internalized an IP address as a dotted set of octets expressed in ASCII digits, that's a problem of comprehension. When you don't, it's pretty natural to just use this stuff like any other integer.

Re:Rust: 128 bit integers preparing to be released by baq on Sunday December 04, 2016 @07:26AM (#13099748)
You're not adding addresses together, that doesn't make sense. You're adding ints to addresses, it's a completely different property, even if the representation happens to fit into the same amount of bits. Nothing more than a convenient coincidence.
Re:Rust: 128 bit integers preparing to be released by eropple on Sunday December 04, 2016 @08:24AM (#13099896)
You're right, I'm not adding addresses together. If you read my post, I say I'm adding to addresses, which you do to--now hold onto your hat--find the next one in sequence. And that, quite obviously, works because they are integers and map to an address space that matches the complete space, from 0x00000000 to 0xFFFFFFFF (and the equivalent 128-bit space for IPv6) of their bit length. It's not "a convenient coincidence". It's the definition of the thing in question.

It's like saying a pointer to RAM isn't an integer. Of course it is, and you add to them every time you de-reference an array in C. That it has additional semantic meaning doesn't mean it stops being a integer. The pedantry you're peddling doesn't fly.

Re:Rust: 128 bit integers preparing to be released by FreeFull on Sunday December 04, 2016 @12:15PM (#13100668)
I think what baq is saying is that IP addresses are torsors http://math.ucr.edu/home/baez/torsors.html . It makes sense to give them a type where you can't add two IP addresses to each other (but you can still subtract to get an integer, and add integers).
Re:Rust: 128 bit integers preparing to be released by eropple on Sunday December 04, 2016 @05:05PM (#13102027)
Sure, fine, but it'll still be an i128 somewhere, yeah? Like, you can put whatever abstraction you want on it, I still need to directly poke those bits and treat it in all ways as fundamentally the same thing as an integer, defined in those terms in order to use integral operations upon them, at the levels that somebody who's worrying about them has to care about. (Also, look at halomru's post for reasons one might intentionally add and subtract addresses from one another in the first place, which kind of holes this argument.)

That is a cool link though, I'm gonna give it a deeper read.

Re:Rust: 128 bit integers preparing to be released by halomru on Sunday December 04, 2016 @08:47AM (#13099965)
>They are never compared for greater-than or less-than.

    if ip >= IP(10.34.12.3) && ip <= IP(10.34.12.9)
        //is one of our database servers
> They are never added, subtracted,

    if abs(atk1.ip - atk2.ip) < 16
        //same source likely, modify threshold
Netmask are useful, but sometimes doing regular math is a better fit for your problem. Adding an integer to an IP, subtracting IPs or comparing IPs all yield meaningful results.
Re:Rust: 128 bit integers preparing to be released by hroi on Sunday December 04, 2016 @09:38AM (#13100100)
What is your point? u32/u128 are not mathematical integers. They are actually bit strings, just like IP addresses and unlike mathematical integers.
Re:Rust: 128 bit integers preparing to be released by Ericson2314 on Sunday December 04, 2016 @09:48AM (#13100128)
They are mathematical cyclic groups!
Re:Rust: 128 bit integers preparing to be released by drfuchs on Sunday December 04, 2016 @12:44AM (#13098930)
But you do want to compare GUIDs. And hash them, which can involve shifting, adding, xor'ing, multiplying, remaindering, etc.
Re:Rust: 128 bit integers preparing to be released by Gankro on Sunday December 04, 2016 @12:54AM (#13098950)
If you can't already hash/compare an array of bytes, something terrible has happened with your language design.
Re:Rust: 128 bit integers preparing to be released by drfuchs on Sunday December 04, 2016 @01:09AM (#13098980)
Not in a way that complies into one or two machine instructions. So, your array code is an order of magnitude or two too slow. Never mind having to write it at all.

Added: I'm talking about implementing specific, optimized hash functions on 128-bit values (e.g. GUIDs, IPv6 addresses), and not generic hash functions that can take any length input (although many of them speed up linearly in the size of int that gets used internally).

Re:Rust: 128 bit integers preparing to be released by Gankro on Sunday December 04, 2016 @01:29AM (#13099032)
Rust isn't hashcode based. You don't define how to hash a type in that way. You define hashing algorithms which operate on arrays of bytes. All a type has to do to implement hashing is specify how to feed its bytes into a hasher.

Hashers provide conveniences for feeding in a u8, u16, u32, u64, etc., but most hashers just implement this as casting the value to an array of bytes and using the generic implementation. This is because most algorithms are defined in terms of bytes. Evidently there isn't any interesting optimization to do by statically knowing you have a u32 vs a u64 for these algorithms (appears to be the case for SipHash, XXHash, and Fnv).

And indeed, u128 continues this tradition in the PR: https://github.com/rust-lang/rust/pull/37900/files#diff-2327...

Re:Rust: 128 bit integers preparing to be released by dbaupp on Sunday December 04, 2016 @01:31AM (#13099034)
Whatever one can do on an i128, one can do "manually" on an array of bytes, e.g. coerce to a pair of u64s to avoid having to manipulate each byte individually.
Re:Rust: 128 bit integers preparing to be released by rickycook on Sunday December 04, 2016 @12:59AM (#13098961)
well, you can already do operations on 128bit of data that represents and int as well, but that's a kind of silly thing to say because higher level abstractions are just about making things easier. so now you can do it in 1 operation rather than several; if that's all you gain, then it's still worth it