whytai

I have a hunch the amount of prs written per day per engineer is likely the same or only 10-15% higher.

sad day to be a chinese founder.

I'm not sure about the time tracking though. Is this more for people working on contract for billing? I see the value in having the data but collecting the data seems difficult.

[1] https://help.obsidian.md/Plugins/Daily+notes

categories of startups that will be affected by these launches: - vectorDB startups -> don't need embeddings anymore

- file processing startups -> don't need to process files anymore

- fine tuning startups -> can fine tune directly from the platform now, with GPT4 fine tuning coming

- cost reduction startups -> they literally lowered prices and increased rate limits

- structuring startups -> json mode and GPT4 turbo with better output matching

- vertical ai agent startups -> GPT marketplace

That being said, Sam Altman is an incredible founder for being able to have this close a watch on the market. Pretty much any "ai tooling" startup that was created in the past year was affected by this announcement.

Exciting times to be a developer!

To make matters worse, the FDA limits the amount of potassium that can be present in supplements to 100mg[2]. So good luck taking 30 supplements to meet your daily requirements!

One option Id like to advertise is salt alternatives at grocery stores which are filled with potassium, some with at least 800mg per tsp. This can be another way to supplement potassium and magnesium in the diet [2]

[1] https://ods.od.nih.gov/factsheets/Potassium-HealthProfession...

[2] https://www.health.harvard.edu/staying-healthy/should-i-take...

- we have a dedicated dev environment for analysts to experience a dev/test loop. None of the pipelines can be run locally unfortunately.

- we have CI jobs and unit tests that are run on all pipelines

Observability:

- we have data quality checks for each dataset, organized by tier. This also integrates with our alerting system to send pagers when data quality dips.

- Airflow and our query engines hive/spark/presto each integrate with our in-house lineage service. We have a lineage graph that shows which pipelines produce/consume which assets but it doesn't work at the column level because our internal version of Hive doesn't support that.

- we have a service that essential surfaces observability metrics for pipelines in a nice ui

- our airflow is integrated with pagerduty to send pagers to owning teams when pipelines fail.

We'd like to do more, but nobody has really put in the work to make a good static analysis system for airflow/python. Couple that with the lack of support for column level lineage OOTB and it's easy to get into a mess. For large migrations (airflow/infra/python/dependecy changes) we still end up doing adhoc analysis to make sure things go right, and we often miss important things.

Happy to talk more about this if you're interested.

Any plans to support airflow in the future? Would love to have something like this for our companies 500k+ airflow jobs.

Excerpt [1]:

> Honeybees accumulate an electric charge during flying. Bees emit constant and modulated electric fields during the waggle dance. Both low- and high-frequency components emitted by dancing bees induce passive antennal movements in stationary bees. The electrically charged flagella of mechanoreceptor cells are moved by electric fields and more strongly so if sound and electric fields interact. Recordings from axons of the Johnston's organ indicate its sensitivity to electric fields. Therefore, it has been suggested that electric fields emanating from the surface charge of bees stimulate mechanoreceptors and may play a role in social communication during the waggle dance.

[1] - https://en.wikipedia.org/wiki/Waggle_dance#Mechanism

[1] https://en.wikipedia.org/wiki/List_of_United_States_extradit...

  In any dispute the intensity of feeling is inversely proportional to the value of the issues at stake

  After graduation, Zhang had trouble finding an academic position. In a 2013 interview with Nautilus magazine, Zhang said he did not get a job after graduation. "During that period it was difficult to find a job in academics. That was a job market problem. Also, my advisor [Tzuong-Tsieng Moh] did not write me letters of recommendation." ... Moh claimed that Zhang never came back to him requesting recommendation letters. In a detailed profile published in The New Yorker magazine in February 2015, Alec Wilkinson wrote Zhang "parted unhappily" with Moh, and that Zhang "left Purdue without Moh's support, and, having published no papers, was unable to find an academic job".

  In 2018, responding to reports of his treatment of Zhang, Moh posted an update on his website. Moh wrote that Zhang "failed miserably" in proving Jacobian conjecture, "never published any paper on algebraic geometry" after leaving Purdue, and "wasted 7 years of his [Zhang's] own life and my [Moh's] time".