Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

replacing the flat index with the IVF family index. #180

Merged
merged 4 commits into from
Nov 20, 2023

Conversation

Thejas-bhat
Copy link
Member

No description provided.

abhinavdangeti
abhinavdangeti previously approved these changes Nov 16, 2023
@abhinavdangeti abhinavdangeti dismissed their stale review November 16, 2023 16:29

Per message from @Thejas-bhat this code'll need a little more work.

section_faiss_vector_index.go Outdated Show resolved Hide resolved
section_faiss_vector_index.go Outdated Show resolved Hide resolved
@abhinavdangeti
Copy link
Member

@Thejas-bhat I'm thinking you should introduce a common helper for the introduce path and merge path where ..

if vectorCount >= 100 {
    indexType = "IVF100,SQ8"
} else if vectorCount >= 10 {
    indexType = "IVF10,Flat"
} else {
    indexType = "IVF1,Flat"
}

@abhinavdangeti abhinavdangeti merged commit d292ef9 into blevesearch:master Nov 20, 2023
6 checks passed
moshaad7 pushed a commit that referenced this pull request Sep 12, 2024
* using IVF instead of flat for smaller indexes

* unit test fix

* cleanup; bug fix: track erro from add_with_ids
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants