- Data Engineering: various DB technologies' pros and cons (AWS Athena, Snowflake, MS Sql Server, Elasticsearch, Redis), Airflow, AWS S3
- ML Engineering: AWS autoscaling clusters, EC2, Spark cluster set-up & management, IO/CPU bottle neck identification, optimizing workloads (like how large chunks, how many Spark worker processes, how many threads on Python's libraries, ...)
- Umm Web Engineering?: HTTP API design, load balancing, Docker & Kubernetes, partial results caching for real-time responses
I have understood that on larger organizations each of these could have a dedicated team behind it. Anyway I've been lucky to find this company & role and gotten an opportunitu to learn and apply so many technologies, but I must admit it is getting a bit tricky to keep (shall I say pickle) all that in my brain :D
The time comes where you have to go back. How do you do it? How do you shed this feeling of being broken goods in the eyes of yourself and (most likely) others? How do you heal the infected wounds of burnout? I can’t figure it out.