You can make AlphaZero learn different value function by changing the reward from the game. Game with no reward from draw, more reward from shorter games with more captures creates different value functions.
Or by training it against a flawed version of the algorithm that tends to overlook best defence like a human would.
This was what made the romantic style possible in the first place: humans perform worse under pressure, so they tend to crack once they're put on the ropes.
It's psychologically easier to attack than to defend accurately
I don’t think that would work. A weird attacking style only works if your attacking moves that technically are losing ones lead to situations so complex that your opponent are unlikely to find the moves that win it for them.
AlphaZero would not have trouble finding the (likely fairly dull) winning moves, and certainly wouldn’t see any reason to play such a move itself.
The chess computing term for this is "contempt," the parameter that determines the worst move the engine assumes its opponent would play. Classical chess engines can allow this parameter to be changed easily. I'm sure the MCTS algorithm for alphazero could be modified to allow this as well, if it doesn't already support it.
[…]
I think you could do this by changing the value function”
The essential thing with AlphaZero is that it doesn’t have a value function that you can change. It learns it from the games it plays against itself.
The best you could do is train it by playing against some algorithm that plays aggressive romantic style (playing against humans playing aggressive romantic style would work, too, but that would make for slow training)
I doubt that would produce an AlphaZero that itself plays aggressive romantic style, though.
Edit: one thing that _might_ work is to, during training, change the rules of chess to “both players lose if the game lasts over N moves” for some small N (40?). That should put incentives on aggressive play. Disadvantage would be that AlphaZero would learn very little about endgames.