News for hackers. Stuff that matters.
Re:Building data structures that are smaller than an array a... by alexbowe on Wednesday February 29, 2012 @11:53PM (#3650977)
Glad you mentioned this. The author linked to my blog post, where I mention fast rank/select structures. There are faster ways to do it without a supporting structure too of course :) but I do like this post.

I'm interested in what you use the WT for in your job... I'm just starting off my PhD in succinct data structures, so it's nice to know that people use them :P

Re:Building data structures that are smaller than an array a... by ot on Thursday March 01, 2012 @04:55AM (#3651549)
Your blog posts about wavelet trees (http://www.alexbowe.com/wavelet-trees) and RRR (http://www.alexbowe.com/yarrr-me-hearties) are very clear and well written!

I've been thinking of writing some blog posts myself for a long time, now I think I will just link to yours.

EDIT: I think WTs should really have a page on Wikipedia...

Re:Building data structures that are smaller than an array a... by alexbowe on Thursday March 01, 2012 @01:12PM (#3653253)
Thanks ot! :) I loved writing them and I hope it shows. Where is your blog at? Yes I was tempted to write a wiki page before...
Re:Building data structures that are smaller than an array a... by ot on Friday March 02, 2012 @04:21AM (#3655976)
> Where is your blog at?

I don't have a blog yet, I was thinking of opening a blog and then write those posts... :)

Re:Building data structures that are smaller than an array a... by gorset on Thursday March 01, 2012 @12:39AM (#3651078)
Cool, WT and succinct data structures are definitely an interesting field these days.

I'm primarily using as a compact order preserving structure to support fast lookups for both (token -> position) and (position -> token). I'm using an updatable variant to support O(1) appends, and then use it for realtime indexing/compression. I probably should do a blog post at one point...

Would be interesting to hear about faster ways to do rank/select without using support structures... I'll keep an eye on your blog :-)

Re:Building data structures that are smaller than an array a... by ot on Thursday March 01, 2012 @03:17AM (#3651379)
> I'm primarily using as a compact order preserving structure to support fast lookups for both (token -> position) and (position -> token). I'm using an updatable variant to support O(1) appends, and then use it for realtime indexing/compression. I probably should do a blog post at one point...

That's very interesting, are you using raw or compressed bitmaps (such as RLE or RRR)? A limitation of (updatable) wavelet trees is that you need to know in advance the set of symbols that you will see (otherwise you would need to change the tree structure). Is it a problem for you? I wrote a paper with a solution to this problem, I can't share it until mid march, let me know if you are interested.

Re:Building data structures that are smaller than an array a... by gorset on Thursday March 01, 2012 @06:43AM (#3651738)
My solution is to use a fixed tree with bloated leaf nodes (use more bits per element in the leaf node). A high number of nodes with a low number of elements causes a high overhead, so I simply rebuild the tree at a few given thresholds to keep the overhad and the cost of the bloated leaf nodes down. We can discuss further by email, if you want. I'd love to read your paper! :-)
Re:Building data structures that are smaller than an array a... by alexbowe on Thursday March 01, 2012 @01:13PM (#3653258)
I'm interested in the paper too of course :D
Re:Building data structures that are smaller than an array a... by alexbowe on Thursday March 01, 2012 @12:55AM (#3651113)
Yes you should do a blog post :) What is your blog address?
Re:Building data structures that are smaller than an array a... by gorset on Thursday March 01, 2012 @01:02AM (#3651125)
http://erik.gorset.no/

not much content, though..

Re:Building data structures that are smaller than an array a... by alexbowe on Thursday March 01, 2012 @01:31AM (#3651179)
Thanks! I'll keep visiting ^^ looks interesting as it is