twmb

Are there performance worries about passing around two pointers for anything that needs to allocate, as well as storing these pointers in a struct? AFAICT this basically means two registers are eaten, and a lot of types have effectively 16 bytes of overhead. It seems like this could quickly change the calculus on what fits within cache lines and what doesn't, which people often care about for very high performance code.

I wonder if it's possible to change the compiler to detect that, if what is being used in arguments is the global default allocator, the first argument can be stripped and all references inside the function can be replaced with the global pointer. Potentially the same concept could apply to allocators that use thread local storage. (perhaps these optimizations already exist?)

Nice! That’s definitely a good practice :).

I’ve tried to make the kgo package easier to use, but I think some libraries suffer from over abstracting the underlying protocol, which ultimately locks them out of some higher efficiency code or some correctness. So, I’ve tried to make the library simple yet not hide all of the details. It’s seemed to have panned out successfully for at least some people. Happy to answer any questions about it, and thanks for taking a look!

I spent quite some time writing github.com/twmb/franz-go due to wanting more from both Sarama and from Segment’s library. Pure Go as well.

I’d recommend evaluating it as an alternative, even to confluent-kafka-go due to comprehensive feature support and (afaict) even higher performance than the aforementioned libraries.

Thanks!

It isn't yet integrated with the schema registry, but I think doing so would be a fairly straightforward task. My primary goal before this "Show HN" was 2.6.0 feature completeness.

I'll look into integrating with the schema registry within the next month. Thanks for the reminder!

edit: there's a few other minor kafkacat features that I'd like to implement as well, such as start and end times for consuming, and producing entire files. I think those two, in addition to avro schema registry, are the main features this is missing, but otherwise kcl is much more featureful.

Long term, I think it'd be great to add support for secrets in vault, but I'd like a bit more usage before considering integrating that.

The opinion article you linked is from a right-rated source [0]. The main suggestion in it,

> That would start with the federal government imposing a national, revenue neutral carbon tax of about $200 per tonne of emissions, immediately (not $50 in 2022 under Trudeau’s plan) and then returning all the money raised back to Canadians in dividend cheques.

has pretty wide support on the left. I'm not sure how that differs from being wealth redistribution, which is what the opinion piece is against. It also doesn't describe what the current scheme is nor how it is wealth redistribution.

As far as party support for nuclear, [1]. Democrats care more about wind/solar. Neither party has majority support for emphasizing nuclear. I don't think people that care about CO2 would rule nuclear out if it were the only option.

Jets vs. thermostat type problems are tragedy of the commons. I don't appreciate private jets ferrying around political leaders, but I doubt they'll be flying commercial. That doesn't seem practical from a security nor time perspective. But, millions of people adjust their thermostats. If everybody tolerated just a liiiiittle bit less than their ideal temperature, how much would that save? Consumption is a tragedy of the commons problem.

I'd like evidence that limousine liberals are the problems w.r.t. taxes. I agree that there is hypocrisy. I disagree about how it rings hollow compared to redistributing the means, especially since "redistributing the means" doesn't even really make sense in that block of text.

Lastly, studies aren't full of blatant inaccuracies nor FUD. The world isn't ending outright, but it's getting a lot worse in a lot of ways in a lot of areas. The Syrian civil war was partially exacerbated by the worst drought ever recorded [2]. The science is settled. Exxon Mobile predicted [3] exactly what would be happening today [4] back in 1982. The conclusion of their summary is that serious adverse problems are not likely to occur until the late century, and that the time should allow for coming up with solutions. That time is now, and globally, we are doing very little, because doing what needs to be done would be economically detrimental to established interests.

[0]: https://mediabiasfactcheck.com/toronto-sun/ [1]: https://news.gallup.com/poll/182180/support-nuclear-energy.a... [2]: https://en.wikipedia.org/wiki/Syrian_Civil_War [3]: https://insideclimatenews.org/sites/default/files/documents/... [4]: https://twitter.com/UNFCCC/status/1125085040768167937

As a recent Brave convert, I was skeptical of Brave for the same reason.

I switched to it from Firefox (after switching months ago from Chrome) due to Firefox being slow, tabs repeatedly crashing, UX disharmony, and the recent cert addon debacle.

Brave's ad proposition makes sense: the internet is inundated with ads, which is unpleasant, but free websites do need to survive. So, make the ad landscape nicer on an opt in basis.

They take privacy seriously. I'd recommend it.

This is a decent reminder blog post about something that is obvious on the surface, but subtle when you forget to think about it and make a mistake.

I've found that thinking of a lock as something you don't want to hold goes a long way. The point of locks is to release them.

Jeff Preshing has a good series on locks and concurrency. This[0] post (potentially with an extra dozen I read in the same sitting) is the one that really changed how I thought about locks: before I read it, I was very into lock freedom at every opportunity.

0: https://preshing.com/20111118/locks-arent-slow-lock-contenti...

I think it is fair, but I can imagine a scenario where a person reads a line and thinks "this is obviously leftist".

Personally, I think company's have been bending over backwards to prove they aren't biasing against the right.

I caution against latching onto the title and making assumptions. The bulk of the content is analyzing where the current censorship position came from and the conclusion is for Google to be more open with their stance and also be more equal with applying it.

As for the why:

  Why the shift toward censorship?
  - User Demands
    - before, In the absence of rules, bad behaviour thrived
    - now, Appease users, maintain platform loyalty
  - Government Demands
    - before, Governments were unhappy to cede power to corporations
    - now, Respond to regulatory demands, maintain global expansion
  - Commercial Demands
    - before, It’s impossible to neutrally promote content and info
    - now, Monetize content through its organisation, increase revenues
    - before, Advertisers were wary of unintended placement and endorsement
    - now, Protect advertisers from controversial content, increase revenues

As for the conclusions:

  Don’t take sides
  Police tone instead of content
  Enforce standards and policies clearly
  Justify global positions
  Explain the technology
  Improve communications
  Take problems seriously
  Positive guidelines
  Better signposts

Most of the document is non-controversial. There are places where it can be seen as obviously left leaning, but there are also places where it acknowledges that sometimes the right has been treated worse:

  “[Richard] Spencer doesn't get to be a verified speaker; Milo gets kicked off, but I know 
  plenty of pretty abusive feminist users or left wing users,
  expressing themselves in exactly the same way
  that the right is being penalised for,
  who are permitted
  to perform certain kinds of speech. That’s going to get Twitter into

Try the Basic HTML view linked at the bottom of https://support.google.com/mail/answer/15049.

It's is web 1.0, but it sticks, and it is fast.

On HN, I mostly see it in replies. Then again, I don't click on all comment sections; maybe I naturally have been avoiding the articles that elicit those comments.

Generally, I expect comment sections that immediately devolve into political discussions to be flagged.

This account looks to have been created for the sole purpose of posting this comment.

I've noticed an increasing trend of top level comments on social commentary articles immediately jumping to "liberals are the problem". Just yesterday, [0], the first reply. I do not see this happening in reverse. It is divisive and disheartening.

[0]: https://news.ycombinator.com/item?id=18099488

Further, this comment does not echo my take on the article as a whole. It's half a book review, half a person's commentary on their life in SV. The key paragraph:

> I felt like I’d ceased to become anything else,” she said. “All I did was work all the time and talk about tech.” She concluded that a job that asked her to jump from crisis to crisis, that did not admit time or perspective to consider many ideas that were outside its small world, was not the best use of her time.

The main gist of the sameness mentioned is that everything is tech.

Where is this political play coming from? Why is it a liberal problem?

Wouldn't drawing attention to bannable offenses be Streisand effect-y?

I think it goes to the rich through systemic imbalance in companies and personal greed of those at the top. Wages should rise.

I don't mean that people should work hard until they die; people should be able to enjoy their lives while working -- hopefully at a job they enjoy, maybe more community oriented as their needs for large salaries to support families goes away.

I don't think that is happening, I think people are nearly destitute, and I see that as the problem.

Agreed, I think that in health cases, there can't be an expectation for people to work. In a better world, our society as a whole would have better end of life support for when people are of ill health.

But, not everybody's mind slips. I'm hopeful that we will have better preventative measures for Alzheimer's and other mind or body crippling diseases soon. I do recall seeing some good news on the Alzheimer's front in the last year.

My first article mentions what you said: past a certain point, it may be more detrimental for some to work.

What is lost in the discussion of retirement ages being bumped is that life expectancy has grown by two decades since the retirement age was introduced in the USA in 1935 [0][1][2]. The retirement age was originally past the point where most people died.

[0]: https://www.theatlantic.com/business/archive/2014/10/how-ret...

[1]: http://www.demog.berkeley.edu/~andrew/1918/figure2.html

[2]: https://fred.stlouisfed.org/series/SPDYNLE00INUSA

I don't personally understand the expectation that average people be economically sustainable while jobless for two decades+. It makes sense to me to slowly increase the retirement age.

It is easy to think that everybody can carve out even a small 5-10m for exercise, but that thought fails to consider people that have had or do have chronic pain or serious injuries.

It is incredibly hard to go from zero to minimal exercise, especially when even basic exercises seem to flare up old injuries. Where do you start? A poorly done crunch might throw out your back again -- do you risk it? Ten push ups might flare up your old tendonosis, should you do any? Your knees are weak from lack of exercise for years, and now 20 free weight squats makes your knees ache the next day -- is this good pain, or will the problem get worse as you do more?

Even without pain, it isn't hard to imagine people being too busy for _most_ of their day to find the motivation to exercise for a simple 10 minutes. Your day might start with a long, early commute to a tedious job. After a long commute back home, it may be hard to say "well, time to strain my body!" That is mentally tough, especially so if you have to prepare dinner, interact with kids, answer late night emails, etc.

I don't scoff at people who fail to exercise. I feel bad for what is going on or had happened in their life that drains them of the motivation or ability to exercise.

Intelligence agencies generally avoid saying exactly why they suggest something and how they came to that conclusion. If agencies were fully open, adversaries would know what holes _they_ need to plug.

From the second post,

> Alternatively, awk '{print $2}' netflix.tsv would have given us the same result. For this tutorial, I use cat to visually separate the input data from the AWK program itself. This also emphasizes that AWK can treat any input and not just existing files.

Also, my numbering got a little off because it's late, and I can't edit. Looks funnier this way.

Taxes are not very high in the US. We have about 26.9% total tax revenue (which I will abbreviate TTR. TTR is measured as a percentage of GDP)[0][1]. I hate seeing this statement thrown out as if it is fact. We have very low taxes comparatively, especially given our status as a highly developed and competitive economy.

We are #7 on the Global Competitive Index, behind Switzerland (29.4% TTR), Singapore (14.2% TTR), Finland (43.6% TTR), Sweden (47.9% TTR), Netherlands (39.8% TTR), and Germany (40.6% TTR) [3].

Sweden, the Netherlands, Finland and other countries that are close below the US have socialist governments. As much as hip, intellectual go-getters who read Ayn Rand would love there to be no government, it's simply not feasible. It may be great in theory, but it's not great in practice. However, I do not know much about the Ayn Rand's entire philosophy, so I wont comment on it further. I do know that most people who blindly latch on to some of her ideas don't truly understand her philosophy.

Half of that 'regulatory capture' you refer to is because of private interests lobbying for government restrictions. The will of the free market may drive such anti-competitive practices by private interests out of business eventually, but humans do not operate on the long term.

Regardless, the point of this post is that even if you thought you opened up your eyes before to the realities of the world and exactly how it should work, I invite you to take a step back every now and then and reevaluate your philosophies.

[0]http://en.wikipedia.org/wiki/List_of_countries_by_tax_revenu... [1]http://www.taxpolicycenter.org/briefing-book/background/numb... [3]http://www3.weforum.org/docs/WEF_GlobalCompetitivenessReport...

I cannot agree more. I was going to respond to the post that the best thing that can happen is being told that you can do all of that.

Once you realize that you can investigate whatever you want, the world opens up for exploration.

No, please. I have many issues with this, coming from the applicant's perspective.

He could have taken his masters program as his full time hobby. There is a reason he went to masters. He loved what he was studying. It only makes sense for all projects for him to work on are ones that are for the masters program. caveat: I believe this holds more-so for Ph.D. people than masters, as masters is still half class based. However, masters students have research projects that take up the other half of their time.

Or, he could have had consistently heavy course loads. The reason that many famous entrepreneurs drop out is because they do not have enough time to do both school and their amazing side project (note, their one amazing side project). This is rare.

Have you considered that >90% of CS graduates are not going to be superstar programmers? At my University, I do not know of any other students doing their own side projects, outside of research projects with professors (this isn't to say I'm the only one, but given what I know, I'd be willing to bet there are fewer than 5 doing something cool).

One of my master theories is that I do need an online presence codewise and blogwise to demonstrate my competence and my passion for building cool stuff. However, to start building projects on GitHub or fixing bugs, you need a pretty descent level of competence. Universities such as mine first immerse you in Java, teach some theoretical CS (algorithms, ...), then have a class on various programming languages then have the upper division courses on C or C++. If you notice, most super cool open source projects these days revolve around C++ at a level that we don't learn, JavaScript, a language that is booming on popularity now but is only touched on in Universities, and Python, which is used in some Universities (those fortunate people) instead of Java. I doubt JavaScript will be seriously taught in Universities for many years. Maybe the Ivy's will have it down, but not everybody goes there. From this we can draw the conclusion that most students wont have the competence to commit to open source projects unless they go off and seriously learn on their own time. Students like that may only build simple projects for themselves and not put it up for show (it's so simple, surely somebody has better functionality somewhere, right?). Why blog? Students like that have nothing profound to talk about.

One of my issues with the frequenters of hacker news is that every programmer expects everybody else to be at least as competent as they are. Not everybody has as high of a drive to code nonstop. I don't. After classes, after oodles of homework and self-teaching the 90% they didn't teach me in class, I want to read books. I enjoy reading. I enjoy hanging out with my friends.

I, unlike most of my fellow students, have realized that dream jobs have ridiculous expectations. I can see why, too: if everybody wants the job, and they are doing something legitimately cool, then it's only reasonable they should have the pick of the litter. However, is your job a dream job? I hate seeing every single application say "two years of experience required" or five. I've been fortunate enough to get internships for the past two summers. Is every graduate expected to take some bullshit big biz job for 2 years, learning very little and becoming embittered by the industry? This is worthless. Some enjoy it, I don't. It'd be better for small companies to take on a promising looking graduate at a slightly less pay and have them expand their knowledge at the company.

Yes, I deserve your job. I'm more than competent enough for it. If I don't have the knowledge you need now, I would be able to learn it in depth within two weeks (give me the full days to learn it). I love what I'm doing, but I love other things too. Having other hobbies besides coding is healthy. Just because you know all the current buzzwords (node, django, backbone, Go, ?) does not mean you are a better coder and does not mean another person without this knowledge is worthless.

I'm wondering if partnering with Netflix and taking the potential flak from TV would be worth it. I don't see the reason for HBO to have HBO Go other than the tie in with TV companies.

Would it be more profitable to pair up with Netflix or to sell their shows drm free easily online? I know I'd pay for that service in a heartbeat, and I wonder how many people who own cable (I don't) would switch to paying for the few channels they actually want. However, I don't want to buy cable for one or two channels / shows, so they lose out from all money I'd willingly give them. I don't want them to cancel an amazing show because of the perceived lack of profit (Spartacus) if they could in fact double their profit from people who would buy their shows directly.

My mistake, has jules pointed out below I was confusing the EU parliament for the European member states.

Actually most of the EU democracy processes are easy to understand. I'd like to see a European comment on the efficacy of their process. Most follow a proportional system, some follow a mix of proportional and single member single district (winner take all), and Great Britain is winner take all.

They also have much more party discipline. Somebody voting for a party knows the type of policies that party will enforce, and if people are not crazy for the policies being passed, the vote in a different party in the next election.

Also, I would argue that lobbying is more prevalent in the US. Low party discipline + the much greater "need" for money = more money influence.

They keep track of how many pages you've read in cookies. Delete your cookies. No reason for brash hostility.

The problem is when they don't use this to track drug networks and murder crimes and instead use it to lock up peaceful Occupy Wall Street protesters, or other political dissidents.