Skip to content

Commit

Permalink
updated ctransformers plugin and the langchain integration
Browse files Browse the repository at this point in the history
  • Loading branch information
Data-drone committed Jul 18, 2023
1 parent 7f07c70 commit 9806bbe
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions 1_Single_QnA_example.py
Original file line number Diff line number Diff line change
Expand Up @@ -118,7 +118,8 @@

# COMMAND ----------

embeddings = HuggingFaceEmbeddings()
embeddings = HuggingFaceEmbeddings(model_name='sentence-transformers/all-mpnet-base-v2',
model_kwargs={'device': 'cpu'})
docsearch = Chroma.from_documents(texts, embeddings)

# we can verify that our docsearch index has objects in it with this
Expand Down Expand Up @@ -189,7 +190,7 @@

# COMMAND ----------

%sh wget -P /local_disk0/ https://huggingface.co/TheBloke/MPT-7B-Instruct-GGML/resolve/main/mpt-7b-instruct.ggmlv3.q5_0.bin
%sh wget -P /local_disk0/ -N https://huggingface.co/TheBloke/MPT-7B-Instruct-GGML/resolve/main/mpt-7b-instruct.ggmlv3.q5_0.bin
# COMMAND ----------

## One problem with the library at the moment is that GPU ram doesn't get relinquished when the object is overridden
Expand Down

0 comments on commit 9806bbe

Please sign in to comment.