See if you can find a copy of Michael Sall's book, it's pricey but it's the definitive guide to the game

A bot that will minimize the expected number of (not yet seen) cards to draw to complete the hand the hand does reasonably well at deciding which card to draw or discard. The number of potential melds in a hand is small enough for modern hardware to completely enumerate, and you start the game with only 42 possible cards in the draw pile, with the number going down almost every turn, so the calculation is very feasible.

For knocking, a heuristic for how many turns vs. amount of deadwood (which should vary based on the undercut bonus you use) does "okay"; adding a bit of randomness should be done to prevent stronger players from being able to place a lower-bounds on your count may be a good idea.

You could apply the AlphaZero algorithm. There are various GitHub repos designed to play games. One of them was connect four, and the model quickly surpassed my skill.

On the other hand that might not work for poker or other information hiding games. (Chess, checkers, and connect four have no hidden info.) I seem to remember an algorithm that can handle this case, but I forgot the name. You’d have to research it.