For mocking downstream dependencies, can I get templates based on existing calls?
Looking forward to this!
When a flow is directly triggered by a users action, we have the Cookie/Token of the user to do AuthN/AuthZ.However when we need to run background jobs or some asynchronous workflow on behalf of the user, we do not have the Cookie/Token of the user. We do have the user id but not the session. How do you solve for AuthZ specifically for your background jobs and dependent microservices?
That's almost a Billion DAUs where a lot of business transactions happen via chat on WhatsApp.
We are planning to adopt SNS as a mechanism for services to publish events to. We will have 8-10 teams that will adopt this and then scale to 30 teams.We have been using Postman for the API development of HTTP APIs (debugging, testing, documentation, sharing with other teams).Is there something similar that helps with the development for APIs that are asynchronous?
Looking to learn from people who have built web/mobile applications on AWS/Azure/GCP at scale (100-200 Million DAUs performing 50:50 write/read operations)
Context: We have a few microservices, each with their own MySQL databases that communicate with each other over HTTP 1.1. A few synchronous operations that constitute a single transaction require writes across two different microservices.The system can end in states where one of the microservices completes it part of the transaction but the other does not and there is no straightforward way to...
Trying to figure out how to build something that would return results fast (sub 100 ms) and also support frequent writes.
Search Engine - Elasticsearch
Data Store - Elasticsearch Scale - 10 million writes/day (500 GB/day), about 100K search queries per dayTrying to figure out1 - How to control access to data (multi-tenancy where there are ~100K tenants)2 - Database design - Indexes and Shards and best practices around mixing different types of documents in a single index.
Trying to put together a list of projects written in Node.js that can serve as a reference for best practices in terms of how the code is organized, appropriate usage of core functionality and everything else that can qualify as good architecture.
Traffic = About 0.5 million requests/minute (HTTPS + WSS) and about 80K concurrent websocket connections with intermittent spikes in traffic.Runs on managed infrastructure on AWS. Almost all the requests are Network (HTTPS) I/O intensive and about a third are Database (MySQL) I/O intensive.
IMHO this is a lot of learning overhead.
Postman allows me to design and mock APIs by simply adding my request and saving the example responses I would like my endpoints to return. The request/response format is what is natural to a web developer and does not need learning another DDL like RAML or OpenAPI/Swagger.
The mock url generated can be directly consumed by anyone without needing any local setup and allows decoupling the consumers of the API from the service deployment allowing parallel development tracks i.e being agile. The documentation comes out of the box when you create anything in Postman and can be shared with your API consumers.
I can then use the same Postman Collection to debug and test my APIs and eventually make it a part of my CI/CD process using their Newman CLI tool or just creating a Postman monitor which runs the API specification with tests on a pre defined schedule and notifies you when the tests fail or experience latency issues in production.
Could be related to software engineering or any other field that is enabled via technology.Do include a link to the talk if it is available online.
Given a dump of several logs files spanning across different components of your server side stack (like proxy, application server) what is the fastest technique/tool to determine what caused an error?I have a bunch of services running on AWS EC2 instances (with nginx and docker) managed with Elastic Beanstalk. Whenever someone reports an issue, we need to take a look at the logs for finding...
Before Carbon Clean Solutions came along, the Tuticorin chemicals plant used to buy carbon dioxide to make its soda ash. It also bought coal to fire up its boiler. Now, instead of wasting carbon dioxide that burning coal produced, the plant is capturing it and saving the money on buying any more carbon dioxide. As a plus, the CO2 supply is also more reliable than before.
“I am a businessman,” Ramachandran Gopalan, the managing director of the Tuticorin plant, told the BBC. “I never thought about saving the planet. I needed a reliable stream of CO2, and this was the best way of getting it.”
https://qz.com/878674/two-indian-engineers-have-drastically-...
[1] - https://github.com/postmanlabs/postman-collection
[2] - https://github.com/postmanlabs/postman-collection-transforme...
Do you use a third party service (like social auth), an identity provider or use your own? If so what are the pros/cons from your experience?
In terms of storing the data, we had a system where the content would be zipped after the content developers were done with the authoring and sent to a place which would convert it into appropriate JSON documents with the metadata and versioning information stored in the DB while the the document content could be stored in the cloud or a document database like Mongo or just Postgres. The content authors only knew excel who were trained to follow a schema while writing the content. That was like a low cost CMS. You can update only the content that has a diff or the entire content depending on how well you can identify a diff for the content. The entire content makes it simple.
Following stoicism helps. I read the book listed below that explains it well. My main takeaway from that book was that it is much easier to be happy if one stops caring about two things - External validation and Instant Gratification.
"One of the great fears many of us face is that despite all our effort and striving, we will discover at the end that we have wasted our life." - https://www.goodreads.com/book/show/5617966-a-guide-to-the-g...
https://www.goodreads.com/book/show/26043368-the-gita-for-ch... answers questions like 'How can one win a war when it involves killing ones own family?' with teachings like 'Do your duty with single minded focus and great sincerity, without worrying about the results of the work'
More often than not, I get people who have decent work experience and seem suited for a role but fail to unlearn and re-learn new ways of doing things. A lot of these people tend to come from a service company background where they do not dive deep into solving problems with code and instead try to cut-paste from across the internet which is good enough for projects that might not ever get...