Re:Removing Array Duplicates
by magicalhippo on Friday April 12, 2019 @09:14AM
(#19644479)
Of course, for low values of N the constants dropped from the big-O notation start to matter. For very small values of N and a random-access input, even an O(N^2) approach may be optimal (for each input element, check for equality against previous elements of the input, output if no hit).
Well, when N is small, any complexity analysis is moot.
Re:Removing Array Duplicates
by magicalhippo on Sunday April 14, 2019 @05:35AM
(#19658390)
Yes, but it's easy to forget and still apply it blindly in regimes where it's not really applicable anymore.
Many hash tables use tree structures rather than actual key hashing because it turns out that this is usually faster on modern machines. So many hash tables are technically O(n log n) for some high log factor like 32.
I've posted what I think is the optimal solution and the research behind it above, if you're curious how to hit O(n) time without brutal constants.
Since the array size is known ahead of time, it's easy to initialize a hash table with an optimal capacity. No need to use fancy tree structure.
OP's approach is by sorting which has complexity of O(m * N * logN) where m is the average key length and N is the size of the array. GP's approach with hash lookup has a complexity of O(m * N) where m is the average key length and N is the size of the array. The extra logN term makes OP's approach slower.