sonalgoyal

GitHub only keeps 14 days of traffic data. After that it's gone. Due to this, a lot of our questions remained unanswered over a long window.

— Was there a spike in clones last month, and where did it come from? — Which docs pages are actually being read? — How many people came to the repo over the last 3 months?

We were flying blind. Not the best way to maintain an open source repo.

So build zingg-stats — a small daily automation that runs three Python scripts every morning and posts everything to Slack:

→ GitHub traffic (views, clones, referrers) saved to CSV before the 14-day window closes → Charts showing trends over the last 3 months → Google Analytics summary from yesterday

We built it with Claude and kept it generic enough that any open source maintainer should be able to adapt it to their own project in an afternoon.

If you run an open source project and have the same blind spots, give it a try.

As part of my data consulting, I struggled with identity resolution and started working on scalable no code identity resolution - https://github.com/zinggAI/zingg/ . It has pushed my limits as a software engineer and product builder, and I had to do a lot of learning to build it. Its cool to see people use Zingg in their workflows and save months of working on custom solutions. Big highlight has been North Carolina Open Campaign Data https://crossroads-cx.medium.com/building-open-access-to-nc-...

Thanks KrishD!

Thanks for posting this - I am the author of the post and glad you found my journey worth sharing.

Thanks for your support. Yes we do ship with some examples and their models which can be run out of the box. We have 3 customer demographic datasets and an ecommerce items matching across Google and Amazon. You can check them here https://github.com/zinggAI/zingg/tree/main/examples

thanks a lot bencastleton, means a lot!

Hmm..guess we will wait along and keep an eye on such datasets.

Hi rishsriv,

Thanks for liking zingg, super excited to hear this :-) Here are some performance numbers. https://docs.zingg.ai/docs/setup/hardwareSizing.html

We see performance varies by a) Number of attributes to match b) Size of data c) Type of matching and the features we compute for each d) Hardware and cluster size

Although we do not do matching across languages like English with Chinese, we have tested Zingg quite rigorously with Chinese, Japanese, Hindi, German and other languages and it seems to work out of the box. Likely due to the inbuilt Java unicode support and the ML based learning.

You make a great point about continuous variables like lat/long, age etc. Age seems to work, again due to integer differences and the learning. Have not tried lat/long yet. Would you have any dataset you could recommend for testing?

Thank you, hope you find it useful! :-)

This is a great reply !

Users get better services, personalised offers and no spamming even when they have already bought a product. Hopefully! :)

I kind of like it that my husband is a programmer. We are able to brainstorm about a lot more things as our backgrounds and day to day challenges are similar. I am not sure how it works out if two people are in completely different professions, but I think work does fill up a lot of our lives, especially as we get older. So its nice to be able to speak the same language (pun intended :-))