Upgrade gensim to v4

[dcferreira]

I'm using this package with some other code I had, which was already using gensim v4, so I thought I'd upgrade it.

I tested manually by running the commands in the README and everything seemed to be working.
But there are no tests, so it's hard to be completely sure I didn't break something.

This PR just upgrades the required versions of some packages, and changes the code to use the gensim v4 API instead of v3.
I followed this guide to do the upgrade: https://github.com/RaRe-Technologies/gensim/wiki/Migrating-from-Gensim-3.x-to-4

[akb89]

Hi @dcferreira,
Thank you for the pull request!
I am working on something else at the moment so I cannot fully check it, but as soon as I have time I will take a look at it and merge it with master if everything works fine.
Meanwhile, I'm gonna leave this open here not to forget.
Thanks again!
Alex

[dcferreira]

Hey @akb89!

I've stopped working on this in the meanwhile, but for a while I was trying to run nonce2vec on bigger datasets, and so was trying to make it faster (in the end I didn't manage to make it fast enough, so dropped the idea).
If you're interested, you can have a look at my branch: https://github.com/dcferreira/nonce2vec/tree/optimize
These are the major changes:

• Multiple nonces are added at once, instead of one at a time
• Added some tests for correctness
• "Modernized" the repo by using the new pyproject.toml file and hatch

I didn't submit a PR as it is, because my main.py is not complete, but if you're interested in this I can spend some more time bringing it up to par with the main.py of the main repo.

[akb89]

Ok! I won't be able to take a look at this within the next 6months at least but I'll make sure to take a look as soon as I can.
Thanks again!