Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

divisi2.network is unnecessarily slow #1

Open
rspeer opened this issue Apr 9, 2010 · 1 comment
Open

divisi2.network is unnecessarily slow #1

rspeer opened this issue Apr 9, 2010 · 1 comment

Comments

@rspeer
Copy link
Member

rspeer commented Apr 9, 2010

Right now when finding the nodes we might want to put into a matrix from a semantic network, we prune the undirected version of the network using networkx to make sure concepts have a high enough degree, put those into a matrix, and prune again using SparseMatrix.squish() to make sure features have a high enough degree as well.

If we could instead represent what goes into the matrix as a bipartite undirected NetworkX graph in the first place, then we could do the pruning right the first time, and make AnalogySpace faster.

@rspeer
Copy link
Member Author

rspeer commented May 3, 2010

The most common case has been fixed because conceptnet_matrix() now just loads a reasonably-sized pickle file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant