This is really cool, and I enjoyed hearing explanations of your process and decision making in the video. It sounds like you have a lot of ideas on how to develop "personalities" for units, and that's something rarely seen in game AI, so I'm eager to see where you go with all of this!
Here's a tech demo of what I've been working on: https://www.youtube.com/watch?v=7q0l87hwmkI
I created a path finding algorithm that can simultaneously path 300,000 units to random destinations at a comfortable frame rate. Units can choose from any of the shortest paths between two points (there are many in a grid), and from those paths, can also choose the path that matches any preferences they have.
Very early stages of development still!