Alternatively, you could check out his non-fiction, say Selected Non-Fictions (https://www.amazon.com/Borges-Selected-Non-Fictions-Jorge-Lu...). Checking the table of contents, I particularly like "A New Refutation of Time" (Available from Gwern: https://www.gwern.net/docs/borges/1947-borges-anewrefutation...), "Pascal's Sphere" (also available: https://www.gwern.net/docs/borges/1951-borges-pascalssphere....), and the lecture "Blindness" (https://www.gwern.net/docs/borges/1977-borges-blindness.pdf; there may be some copyright issues here).

He published a couple of short story anthologies in the 1940s: Fictions, Aleph - check your local library for a translation.

I smiled when in this lecture when he goes off on a tangent about Don Quixote and then imagines a fictional version of himself "I, for example, was born the same day as Jorge Luis Borges, exactly the same day".

That may well be Borges' inception concerning a fictional author with the nom de plume Pierre Menard. Ostensibly this is a lecture about Boswell but he has left a cue to an earlier short story.

https://en.m.wikipedia.org/wiki/Pierre_Menard,_Author_of_the...

Would recommend reading everything in Collected Fictions.