mapleshamrock

Couldn't you do something like add a bidirectional encoder after your embedding look up table to compress your text into some smaller token-count semantic space before feeding your transformer blocks to get a similar effect, then?

Funny, Normal People comes out of Ireland, historically a very sexually repressed nation under the thumb of the Catholic Church. Times are changing rapidly in Ireland though.

Exactly. Capital gains tax is equivalent to a wealth tax on appreciating assets only, which is the only kind of assets you should be targeting with a wealth tax. So just implement a sensible capital gains tax, and you're done.

I'd largely disagree. There's a huge amount of R&D and Engineering work being done in Ireland.

On the hardware side Intel, Qualcomm, Huawei, HP, Analog Devices, Xilinx, Nokia Bell Labs and many more all have extensive R&D departments in Ireland.

On the software side, Amazon, Microsoft, Facebook, Google etc. all have engineering roles advertised currently on Linkedin.

This is it - you can't just compare FP32 TFLOPS. The newer cards have a ton of extra precisions, custom cores for certain workloads, and on chip memory, all of which use silicon area and transistors, but none of which boost the FP32 TFLOPS metric.

I could design you a chip that is nothing but FP32 multipliers and adders that has, theoretically, a ridiculous TFLOPS per mm^2, but it would be next to useless in any real workload.

What keywords should I search for on Fiverr to see examples/how this service is marketed?

On CPU, assuming inference is compute bound rather than bandwidth bound, the compute time will scale quadratically with the size of the FC layers (which account for almost all compute time in these networks). So if the hidden size was 768 in BERT-Base, and 4096 in ALBERT, inference will approximately be 28.4x slower... yikes.

Woah there, the person you're replying to didn't once use the word "weird" or any synonyms thereof.

They said that men and women tend to have different broad interests. But that doesn't preclude women from having an interest in tech. He's making a statement on statistics, not making a value judgement about anybody.