milvus #184

gyliu513 · 2024-07-25T20:02:15Z

PR Type

enhancement, tests

Description

Added a new Jupyter Notebook file milvus.ipynb to demonstrate the setup and usage of Milvus with pymilvus.
The notebook includes steps to install necessary dependencies like pymilvus, pandas, environs, and others.
Introduced code snippets to create a Milvus client, manage collections, and encode documents using the pymilvus model.
Added commands to upgrade jupyter and ipywidgets to ensure compatibility.

Changes walkthrough 📝

Relevant files

Enhancement

milvus.ipynb `Add Milvus setup and usage example in Jupyter Notebook` milvus/milvus.ipynb Added installation commands for `pymilvus`, `pandas`, `environs`, and other dependencies. Introduced code to create a Milvus client and manage collections. Included commands to install `pymilvus[model]` and `jupyter` with `ipywidgets`. Added code to encode documents using `pymilvus` model and handle embeddings.	+480/-0

💡 PR-Agent usage:
Comment /help on the PR to get a list of all available PR-Agent tools and their descriptions

Summary by CodeRabbit

New Features
- Introduced a Jupyter Notebook to demonstrate the use of the pymilvus library for managing collections in a Milvus database.
- Added functionality for creating and managing a collection named "demo_collection" with vector embeddings.
- Included steps for encoding documents into vectors and handling dependency installation feedback.
Bug Fixes
- Improved error handling related to the installation of necessary packages to enhance user experience.

coderabbitai · 2024-07-25T20:02:20Z

Walkthrough

The updates introduce a Jupyter Notebook (milvus/milvus.ipynb) that demonstrates the use of the pymilvus library for managing collections in a Milvus database. It includes steps for setting up the environment, creating and managing a collection, encoding documents into vectors, and preparing data for further processing. The changes enhance usability and provide clear guidance for users interacting with the Milvus database.

Changes

File(s)	Change Summary
`milvus/milvus.ipynb`	Added a Jupyter Notebook demonstrating `pymilvus` for collection management and document encoding.
`milvus_model/dense/onnx.py`	Contextual usage of `encode_documents` in `OnnxEmbeddingFunction` remains unchanged in signature.

Sequence Diagram(s)

sequenceDiagram
    participant User
    participant Jupyter Notebook
    participant pymilvus
    participant Milvus DB

    User->>Jupyter Notebook: Start demo
    Jupyter Notebook->>pymilvus: Install packages
    Jupyter Notebook->>Milvus DB: Check for collection
    Milvus DB-->>Jupyter Notebook: Collection status
    Jupyter Notebook->>Milvus DB: Drop collection (if exists)
    Jupyter Notebook->>Milvus DB: Create new collection
    Jupyter Notebook->>pymilvus: Encode documents
    pymilvus-->>Jupyter Notebook: Return encoded vectors
    Jupyter Notebook->>User: Show results

Poem

In the garden where data grows,
A rabbit hops where the Milvus flows.
With vectors bright and collections neat,
We encode the tales, oh what a treat!
So gather 'round, let's share the cheer,
For every change brings us near! 🐇✨

Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?

Share

Tips

Chat

There are 3 ways to chat with CodeRabbit:

Review comments: Directly reply to a review comment made by CodeRabbit. Example:
- I pushed a fix in commit <commit_id>.
- Generate unit testing code for this file.
- Open a follow-up GitHub issue for this discussion.
Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
- @coderabbitai generate unit testing code for this file.
- @coderabbitai modularize this function.
PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
- @coderabbitai generate interesting stats about this repository and render them as a table.
- @coderabbitai show all the console.log statements in this repository.
- @coderabbitai read src/utils.ts and generate unit testing code.
- @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.
- @coderabbitai help me debug CodeRabbit configuration file.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (invoked as PR comments)

@coderabbitai pause to pause the reviews on a PR.
@coderabbitai resume to resume the paused reviews.
@coderabbitai review to trigger an incremental review. This is useful when automatic reviews are disabled for the repository.
@coderabbitai full review to do a full review from scratch and review all the files again.
@coderabbitai summary to regenerate the summary of the PR.
@coderabbitai resolve resolve all the CodeRabbit review comments.
@coderabbitai configuration to show the current CodeRabbit configuration for the repository.
@coderabbitai help to get help.

Additionally, you can add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.

CodeRabbit Configuration File (`.coderabbit.yaml`)

You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
Please see the configuration documentation for more information.
If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.json

Documentation and Community

Visit our Documentation for detailed information on how to use CodeRabbit.
Join our Discord Community to get help, request features, and share feedback.
Follow us on X/Twitter for updates and announcements.

github-actions · 2024-07-25T20:03:18Z

PR Reviewer Guide 🔍

⏱️ Estimated effort to review: 4 🔵🔵🔵🔵⚪
🧪 No relevant tests
🔒 No security concerns identified
⚡ Key issues to review Error Handling The notebook should include error handling for operations that might fail, such as network requests or file operations. This is crucial to ensure the notebook is robust and can handle unexpected situations gracefully. Dependency Management The notebook installs many packages directly using pip. It's recommended to manage dependencies in a separate requirements file or use a virtual environment to avoid conflicts with global packages. Code Execution Flow The notebook should ensure that all cells are executable in a linear order without requiring manual interventions or adjustments in the code flow. Output Clarity The notebook outputs raw installation logs directly into the notebook cells. It would be better to suppress these logs or provide a cleaner output to enhance readability. Possible Bug There's an unhandled TypeError in the notebook which could interrupt the execution flow. This needs debugging and proper exception handling.

github-actions · 2024-07-25T20:03:20Z

PR Code Suggestions ✨

Category	Suggestion	Score
Security	Validate database names to prevent injection attacks To prevent potential security risks, validate or sanitize inputs that are used in database operations to avoid SQL injection or similar attacks. milvus/milvus.ipynb [68] -client = MilvusClient("milvus_demo.db") +import re +db_name = "milvus_demo.db" +if re.match("^[a-zA-Z0-9_\-\.]+$", db_name): + client = MilvusClient(db_name) +else: + raise ValueError("Invalid database name.") Suggestion importance[1-10]: 8 Why: This suggestion addresses a significant security concern by validating the database name, which helps prevent injection attacks and ensures safer code.	8
Maintainability	Replace hard-coded strings with variables for better code flexibility Replace the hard-coded collection name 'demo_collection' with a variable to enhance code flexibility and maintainability. milvus/milvus.ipynb [77-82] -if client.has_collection(collection_name="demo_collection"): - client.drop_collection(collection_name="demo_collection") +collection_name = "demo_collection" +if client.has_collection(collection_name=collection_name): + client.drop_collection(collection_name=collection_name) client.create_collection( - collection_name="demo_collection", + collection_name=collection_name, dimension=768, # The vectors we will use in this demo has 768 dimensions ) Suggestion importance[1-10]: 7 Why: This suggestion improves code maintainability by replacing hard-coded strings with variables, making the code more flexible and easier to update in the future.	7
Best practice	Use a context manager for package installation to handle resources and errors Use a context manager to handle the installation of packages to ensure that resources are properly managed and potential errors are handled. milvus/milvus.ipynb [57] -!pip install -U pymilvus +import subprocess +with subprocess.Popen(["pip", "install", "-U", "pymilvus"], stdout=subprocess.PIPE, stderr=subprocess.PIPE) as proc: + stdout, stderr = proc.communicate() + if proc.returncode != 0: + print(f"Error installing pymilvus: {stderr.decode()}") + else: + print(stdout.decode()) Suggestion importance[1-10]: 5 Why: While using a context manager can improve resource management and error handling, the suggested change adds complexity to a simple package installation command, which might not be necessary in this context.	5
Best practice	Replace deprecated methods with their recommended alternatives Avoid using deprecated or soon-to-be-deprecated methods like `has_collection` and `drop_collection` if they are planned to be deprecated in future versions of the library. milvus/milvus.ipynb [77-78] -if client.has_collection(collection_name="demo_collection"): - client.drop_collection(collection_name="demo_collection") +if client.collection_exists(collection_name="demo_collection"): + client.remove_collection(collection_name="demo_collection") Suggestion importance[1-10]: 4 Why: The suggestion is good in principle, but it assumes knowledge of future deprecations that are not confirmed in the provided context. Without evidence of deprecation, the change is speculative.	4

coderabbitai

Actionable comments posted: 4

Review details

Configuration used: CodeRabbit UI
Review profile: CHILL

Commits

Files that changed from the base of the PR and between cdb5033 and 880961d.

Files ignored due to path filters (1)

milvus/milvus_demo.db is excluded by !**/*.db

Files selected for processing (1)

milvus/milvus.ipynb (1 hunks)

Additional comments not posted (2)

milvus/milvus.ipynb (2)

61-69: LGTM!

The code correctly imports and initializes the MilvusClient.

72-82: LGTM!

The code correctly checks for and creates a collection.

coderabbitai · 2024-07-25T20:06:46Z

milvus/milvus.ipynb

+{
+ "cells": [
+  {
+   "cell_type": "code",
+   "execution_count": 1,
+   "metadata": {},
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "Collecting pymilvus\n",
+      "  Using cached pymilvus-2.4.4-py3-none-any.whl (196 kB)\n",
+      "Collecting pandas>=1.2.4\n",
+      "  Downloading pandas-2.2.2-cp310-cp310-macosx_11_0_arm64.whl (11.3 MB)\n",
+      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m11.3/11.3 MB\u001b[0m \u001b[31m16.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m00:01\u001b[0m\n",
+      "\u001b[?25hCollecting environs<=9.5.0\n",
+      "  Using cached environs-9.5.0-py2.py3-none-any.whl (12 kB)\n",
+      "Requirement already satisfied: ujson>=2.0.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus) (5.8.0)\n",
+      "Requirement already satisfied: protobuf>=3.20.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus) (4.25.3)\n",
+      "Collecting milvus-lite<2.5.0,>=2.4.0\n",
+      "  Using cached milvus_lite-2.4.8-py3-none-macosx_11_0_arm64.whl (19.8 MB)\n",
+      "Collecting setuptools>=67\n",
+      "  Using cached setuptools-71.1.0-py3-none-any.whl (2.3 MB)\n",
+      "Collecting grpcio<=1.63.0,>=1.49.1\n",
+      "  Downloading grpcio-1.63.0-cp310-cp310-macosx_12_0_universal2.whl (10.1 MB)\n",
+      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m10.1/10.1 MB\u001b[0m \u001b[31m16.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m0:01\u001b[0m\n",
+      "\u001b[?25hRequirement already satisfied: python-dotenv in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from environs<=9.5.0->pymilvus) (1.0.1)\n",
+      "Collecting marshmallow>=3.0.0\n",
+      "  Using cached marshmallow-3.21.3-py3-none-any.whl (49 kB)\n",
+      "Requirement already satisfied: tqdm in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from milvus-lite<2.5.0,>=2.4.0->pymilvus) (4.66.4)\n",
+      "Collecting pytz>=2020.1\n",
+      "  Using cached pytz-2024.1-py2.py3-none-any.whl (505 kB)\n",
+      "Requirement already satisfied: python-dateutil>=2.8.2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pandas>=1.2.4->pymilvus) (2.9.0.post0)\n",
+      "Requirement already satisfied: numpy>=1.22.4 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pandas>=1.2.4->pymilvus) (2.0.0)\n",
+      "Collecting tzdata>=2022.7\n",
+      "  Using cached tzdata-2024.1-py2.py3-none-any.whl (345 kB)\n",
+      "Requirement already satisfied: packaging>=17.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from marshmallow>=3.0.0->environs<=9.5.0->pymilvus) (24.1)\n",
+      "Requirement already satisfied: six>=1.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from python-dateutil>=2.8.2->pandas>=1.2.4->pymilvus) (1.16.0)\n",
+      "Installing collected packages: pytz, tzdata, setuptools, milvus-lite, marshmallow, grpcio, pandas, environs, pymilvus\n",
+      "  Attempting uninstall: setuptools\n",
+      "    Found existing installation: setuptools 65.5.0\n",
+      "    Uninstalling setuptools-65.5.0:\n",
+      "      Successfully uninstalled setuptools-65.5.0\n",
+      "  Attempting uninstall: grpcio\n",
+      "    Found existing installation: grpcio 1.65.1\n",
+      "    Uninstalling grpcio-1.65.1:\n",
+      "      Successfully uninstalled grpcio-1.65.1\n",
+      "Successfully installed environs-9.5.0 grpcio-1.63.0 marshmallow-3.21.3 milvus-lite-2.4.8 pandas-2.2.2 pymilvus-2.4.4 pytz-2024.1 setuptools-71.1.0 tzdata-2024.1\n",
+      "\n",
+      "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip is available: \u001b[0m\u001b[31;49m23.0.1\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m24.1.2\u001b[0m\n",
+      "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpip install --upgrade pip\u001b[0m\n"
+     ]
+    }
+   ],
+   "source": [
+    "!pip install -U pymilvus"
+   ]


Minimize installation output logs and upgrade pip.

The output logs from the installation command are included, which can be minimized for readability. Additionally, consider upgrading pip to avoid the notice messages.

- !pip install -U pymilvus + !pip install -U pymilvus > /dev/null + !pip install --upgrade pip > /dev/null

Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change

{

"cells": [

{

"cell_type": "code",

"execution_count": 1,

"metadata": {},

"outputs": [

{

"name": "stdout",

"output_type": "stream",

"text": [

"Collecting pymilvus\n",

" Using cached pymilvus-2.4.4-py3-none-any.whl (196 kB)\n",

"Collecting pandas>=1.2.4\n",

" Downloading pandas-2.2.2-cp310-cp310-macosx_11_0_arm64.whl (11.3 MB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m11.3/11.3 MB\u001b[0m \u001b[31m16.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m00:01\u001b[0m\n",

"\u001b[?25hCollecting environs<=9.5.0\n",

" Using cached environs-9.5.0-py2.py3-none-any.whl (12 kB)\n",

"Requirement already satisfied: ujson>=2.0.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus) (5.8.0)\n",

"Requirement already satisfied: protobuf>=3.20.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus) (4.25.3)\n",

"Collecting milvus-lite<2.5.0,>=2.4.0\n",

" Using cached milvus_lite-2.4.8-py3-none-macosx_11_0_arm64.whl (19.8 MB)\n",

"Collecting setuptools>=67\n",

" Using cached setuptools-71.1.0-py3-none-any.whl (2.3 MB)\n",

"Collecting grpcio<=1.63.0,>=1.49.1\n",

" Downloading grpcio-1.63.0-cp310-cp310-macosx_12_0_universal2.whl (10.1 MB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m10.1/10.1 MB\u001b[0m \u001b[31m16.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m0:01\u001b[0m\n",

"\u001b[?25hRequirement already satisfied: python-dotenv in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from environs<=9.5.0->pymilvus) (1.0.1)\n",

"Collecting marshmallow>=3.0.0\n",

" Using cached marshmallow-3.21.3-py3-none-any.whl (49 kB)\n",

"Requirement already satisfied: tqdm in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from milvus-lite<2.5.0,>=2.4.0->pymilvus) (4.66.4)\n",

"Collecting pytz>=2020.1\n",

" Using cached pytz-2024.1-py2.py3-none-any.whl (505 kB)\n",

"Requirement already satisfied: python-dateutil>=2.8.2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pandas>=1.2.4->pymilvus) (2.9.0.post0)\n",

"Requirement already satisfied: numpy>=1.22.4 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pandas>=1.2.4->pymilvus) (2.0.0)\n",

"Collecting tzdata>=2022.7\n",

" Using cached tzdata-2024.1-py2.py3-none-any.whl (345 kB)\n",

"Requirement already satisfied: packaging>=17.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from marshmallow>=3.0.0->environs<=9.5.0->pymilvus) (24.1)\n",

"Requirement already satisfied: six>=1.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from python-dateutil>=2.8.2->pandas>=1.2.4->pymilvus) (1.16.0)\n",

"Installing collected packages: pytz, tzdata, setuptools, milvus-lite, marshmallow, grpcio, pandas, environs, pymilvus\n",

" Attempting uninstall: setuptools\n",

" Found existing installation: setuptools 65.5.0\n",

" Uninstalling setuptools-65.5.0:\n",

" Successfully uninstalled setuptools-65.5.0\n",

" Attempting uninstall: grpcio\n",

" Found existing installation: grpcio 1.65.1\n",

" Uninstalling grpcio-1.65.1:\n",

" Successfully uninstalled grpcio-1.65.1\n",

"Successfully installed environs-9.5.0 grpcio-1.63.0 marshmallow-3.21.3 milvus-lite-2.4.8 pandas-2.2.2 pymilvus-2.4.4 pytz-2024.1 setuptools-71.1.0 tzdata-2024.1\n",

"\n",

"\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip is available: \u001b[0m\u001b[31;49m23.0.1\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m24.1.2\u001b[0m\n",

"\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpip install --upgrade pip\u001b[0m\n"

]

}

],

"source": [

"!pip install -U pymilvus"

]

{

"cells": [

{

"cell_type": "code",

"execution_count": 1,

"metadata": {},

"outputs": [

{

"name": "stdout",

"output_type": "stream",

"text": [

"Collecting pymilvus\n",

" Using cached pymilvus-2.4.4-py3-none-any.whl (196 kB)\n",

"Collecting pandas>=1.2.4\n",

" Downloading pandas-2.2.2-cp310-cp310-macosx_11_0_arm64.whl (11.3 MB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m11.3/11.3 MB\u001b[0m \u001b[31m16.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m00:01\u001b[0m\n",

"\u001b[?25hCollecting environs<=9.5.0\n",

" Using cached environs-9.5.0-py2.py3-none-any.whl (12 kB)\n",

"Requirement already satisfied: ujson>=2.0.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus) (5.8.0)\n",

"Requirement already satisfied: protobuf>=3.20.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus) (4.25.3)\n",

"Collecting milvus-lite<2.5.0,>=2.4.0\n",

" Using cached milvus_lite-2.4.8-py3-none-macosx_11_0_arm64.whl (19.8 MB)\n",

"Collecting setuptools>=67\n",

" Using cached setuptools-71.1.0-py3-none-any.whl (2.3 MB)\n",

"Collecting grpcio<=1.63.0,>=1.49.1\n",

" Downloading grpcio-1.63.0-cp310-cp310-macosx_12_0_universal2.whl (10.1 MB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m10.1/10.1 MB\u001b[0m \u001b[31m16.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m0:01\u001b[0m\n",

"\u001b[?25hRequirement already satisfied: python-dotenv in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from environs<=9.5.0->pymilvus) (1.0.1)\n",

"Collecting marshmallow>=3.0.0\n",

" Using cached marshmallow-3.21.3-py3-none-any.whl (49 kB)\n",

"Requirement already satisfied: tqdm in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from milvus-lite<2.5.0,>=2.4.0->pymilvus) (4.66.4)\n",

"Collecting pytz>=2020.1\n",

" Using cached pytz-2024.1-py2.py3-none-any.whl (505 kB)\n",

"Requirement already satisfied: python-dateutil>=2.8.2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pandas>=1.2.4->pymilvus) (2.9.0.post0)\n",

"Requirement already satisfied: numpy>=1.22.4 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pandas>=1.2.4->pymilvus) (2.0.0)\n",

"Collecting tzdata>=2022.7\n",

" Using cached tzdata-2024.1-py2.py3-none-any.whl (345 kB)\n",

"Requirement already satisfied: packaging>=17.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from marshmallow>=3.0.0->environs<=9.5.0->pymilvus) (24.1)\n",

"Requirement already satisfied: six>=1.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from python-dateutil>=2.8.2->pandas>=1.2.4->pymilvus) (1.16.0)\n",

"Installing collected packages: pytz, tzdata, setuptools, milvus-lite, marshmallow, grpcio, pandas, environs, pymilvus\n",

" Attempting uninstall: setuptools\n",

" Found existing installation: setuptools 65.5.0\n",

" Uninstalling setuptools-65.5.0:\n",

" Successfully uninstalled setuptools-65.5.0\n",

" Attempting uninstall: grpcio\n",

" Found existing installation: grpcio 1.65.1\n",

" Uninstalling grpcio-1.65.1:\n",

" Successfully uninstalled grpcio-1.65.1\n",

"Successfully installed environs-9.5.0 grpcio-1.63.0 marshmallow-3.21.3 milvus-lite-2.4.8 pandas-2.2.2 pymilvus-2.4.4 pytz-2024.1 setuptools-71.1.0 tzdata-2024.1\n",

"\n",

"\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip is available: \u001b[0m\u001b[31;49m23.0.1\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m24.1.2\u001b[0m\n",

"\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpip install --upgrade pip\u001b[0m\n"

]

}

],

"source": [

"!pip install -U pymilvus > /dev/null\n",

"!pip install --upgrade pip > /dev/null\n"

]

}

]

}

coderabbitai · 2024-07-25T20:06:46Z

milvus/milvus.ipynb

+   "cell_type": "code",
+   "execution_count": 4,
+   "metadata": {},
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "Requirement already satisfied: pymilvus[model] in /Users/gyliu/pr-agent/lib/python3.10/site-packages (2.4.4)\n",
+      "Requirement already satisfied: protobuf>=3.20.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (4.25.3)\n",
+      "Requirement already satisfied: pandas>=1.2.4 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (2.2.2)\n",
+      "Requirement already satisfied: environs<=9.5.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (9.5.0)\n",
+      "Requirement already satisfied: grpcio<=1.63.0,>=1.49.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (1.63.0)\n",
+      "Requirement already satisfied: ujson>=2.0.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (5.8.0)\n",
+      "Requirement already satisfied: setuptools>=67 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (71.1.0)\n",
+      "Requirement already satisfied: milvus-lite<2.5.0,>=2.4.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (2.4.8)\n",
+      "Collecting milvus-model>=0.1.0\n",
+      "  Downloading milvus_model-0.2.3-py3-none-any.whl (29 kB)\n",
+      "Requirement already satisfied: marshmallow>=3.0.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from environs<=9.5.0->pymilvus[model]) (3.21.3)\n",
+      "Requirement already satisfied: python-dotenv in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from environs<=9.5.0->pymilvus[model]) (1.0.1)\n",
+      "Requirement already satisfied: tqdm in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from milvus-lite<2.5.0,>=2.4.0->pymilvus[model]) (4.66.4)\n",
+      "Collecting transformers>=4.36.0\n",
+      "  Downloading transformers-4.43.2-py3-none-any.whl (9.4 MB)\n",
+      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m9.4/9.4 MB\u001b[0m \u001b[31m15.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0ma \u001b[36m0:00:01\u001b[0m\n",
+      "\u001b[?25hCollecting onnxruntime\n",
+      "  Downloading onnxruntime-1.18.1-cp310-cp310-macosx_11_0_universal2.whl (15.9 MB)\n",
+      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m15.9/15.9 MB\u001b[0m \u001b[31m16.1 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m00:01\u001b[0m\n",
+      "\u001b[?25hCollecting scipy>=1.10.0\n",
+      "  Downloading scipy-1.14.0-cp310-cp310-macosx_14_0_arm64.whl (23.1 MB)\n",
+      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m23.1/23.1 MB\u001b[0m \u001b[31m15.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m00:01\u001b[0m\n",
+      "\u001b[?25hRequirement already satisfied: numpy in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from milvus-model>=0.1.0->pymilvus[model]) (2.0.0)\n",
+      "Requirement already satisfied: pytz>=2020.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pandas>=1.2.4->pymilvus[model]) (2024.1)\n",
+      "Requirement already satisfied: python-dateutil>=2.8.2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pandas>=1.2.4->pymilvus[model]) (2.9.0.post0)\n",
+      "Requirement already satisfied: tzdata>=2022.7 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pandas>=1.2.4->pymilvus[model]) (2024.1)\n",
+      "Requirement already satisfied: packaging>=17.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from marshmallow>=3.0.0->environs<=9.5.0->pymilvus[model]) (24.1)\n",
+      "Requirement already satisfied: six>=1.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from python-dateutil>=2.8.2->pandas>=1.2.4->pymilvus[model]) (1.16.0)\n",
+      "Requirement already satisfied: filelock in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (3.15.4)\n",
+      "Requirement already satisfied: huggingface-hub<1.0,>=0.23.2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (0.24.0)\n",
+      "Requirement already satisfied: regex!=2019.12.17 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (2024.5.15)\n",
+      "Requirement already satisfied: pyyaml>=5.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (6.0.1)\n",
+      "Requirement already satisfied: tokenizers<0.20,>=0.19 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (0.19.1)\n",
+      "Requirement already satisfied: requests in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (2.32.3)\n",
+      "Collecting safetensors>=0.4.1\n",
+      "  Using cached safetensors-0.4.3-cp310-cp310-macosx_11_0_arm64.whl (410 kB)\n",
+      "Collecting coloredlogs\n",
+      "  Using cached coloredlogs-15.0.1-py2.py3-none-any.whl (46 kB)\n",
+      "Collecting numpy\n",
+      "  Using cached numpy-1.26.4-cp310-cp310-macosx_11_0_arm64.whl (14.0 MB)\n",
+      "Collecting sympy\n",
+      "  Downloading sympy-1.13.1-py3-none-any.whl (6.2 MB)\n",
+      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m6.2/6.2 MB\u001b[0m \u001b[31m16.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m00:01\u001b[0m\n",
+      "\u001b[?25hCollecting flatbuffers\n",
+      "  Using cached flatbuffers-24.3.25-py2.py3-none-any.whl (26 kB)\n",
+      "Requirement already satisfied: fsspec>=2023.5.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.23.2->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (2024.6.1)\n",
+      "Requirement already satisfied: typing-extensions>=3.7.4.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.23.2->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (4.12.2)\n",
+      "Collecting humanfriendly>=9.1\n",
+      "  Using cached humanfriendly-10.0-py2.py3-none-any.whl (86 kB)\n",
+      "Requirement already satisfied: idna<4,>=2.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (3.7)\n",
+      "Requirement already satisfied: urllib3<3,>=1.21.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (2.0.7)\n",
+      "Requirement already satisfied: certifi>=2017.4.17 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (2024.7.4)\n",
+      "Requirement already satisfied: charset-normalizer<4,>=2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (3.3.2)\n",
+      "Collecting mpmath<1.4,>=1.1.0\n",
+      "  Using cached mpmath-1.3.0-py3-none-any.whl (536 kB)\n",
+      "Installing collected packages: mpmath, flatbuffers, sympy, safetensors, numpy, humanfriendly, scipy, coloredlogs, onnxruntime, transformers, milvus-model\n",
+      "  Attempting uninstall: numpy\n",
+      "    Found existing installation: numpy 2.0.0\n",
+      "    Uninstalling numpy-2.0.0:\n",
+      "      Successfully uninstalled numpy-2.0.0\n",
+      "Successfully installed coloredlogs-15.0.1 flatbuffers-24.3.25 humanfriendly-10.0 milvus-model-0.2.3 mpmath-1.3.0 numpy-1.26.4 onnxruntime-1.18.1 safetensors-0.4.3 scipy-1.14.0 sympy-1.13.1 transformers-4.43.2\n",
+      "\n",
+      "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip is available: \u001b[0m\u001b[31;49m23.0.1\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m24.1.2\u001b[0m\n",
+      "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpip install --upgrade pip\u001b[0m\n"
+     ]
+    }
+   ],
+   "source": [
+    "!pip install \"pymilvus[model]\""
+   ]


Minimize installation output logs and upgrade pip.

The output logs from the installation command are included, which can be minimized for readability. Additionally, consider upgrading pip to avoid the notice messages.

- !pip install "pymilvus[model]" + !pip install "pymilvus[model]" > /dev/null + !pip install --upgrade pip > /dev/null

Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change

"cell_type": "code",

"execution_count": 4,

"metadata": {},

"outputs": [

{

"name": "stdout",

"output_type": "stream",

"text": [

"Requirement already satisfied: pymilvus[model] in /Users/gyliu/pr-agent/lib/python3.10/site-packages (2.4.4)\n",

"Requirement already satisfied: protobuf>=3.20.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (4.25.3)\n",

"Requirement already satisfied: pandas>=1.2.4 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (2.2.2)\n",

"Requirement already satisfied: environs<=9.5.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (9.5.0)\n",

"Requirement already satisfied: grpcio<=1.63.0,>=1.49.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (1.63.0)\n",

"Requirement already satisfied: ujson>=2.0.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (5.8.0)\n",

"Requirement already satisfied: setuptools>=67 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (71.1.0)\n",

"Requirement already satisfied: milvus-lite<2.5.0,>=2.4.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (2.4.8)\n",

"Collecting milvus-model>=0.1.0\n",

" Downloading milvus_model-0.2.3-py3-none-any.whl (29 kB)\n",

"Requirement already satisfied: marshmallow>=3.0.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from environs<=9.5.0->pymilvus[model]) (3.21.3)\n",

"Requirement already satisfied: python-dotenv in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from environs<=9.5.0->pymilvus[model]) (1.0.1)\n",

"Requirement already satisfied: tqdm in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from milvus-lite<2.5.0,>=2.4.0->pymilvus[model]) (4.66.4)\n",

"Collecting transformers>=4.36.0\n",

" Downloading transformers-4.43.2-py3-none-any.whl (9.4 MB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m9.4/9.4 MB\u001b[0m \u001b[31m15.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0ma \u001b[36m0:00:01\u001b[0m\n",

"\u001b[?25hCollecting onnxruntime\n",

" Downloading onnxruntime-1.18.1-cp310-cp310-macosx_11_0_universal2.whl (15.9 MB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m15.9/15.9 MB\u001b[0m \u001b[31m16.1 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m00:01\u001b[0m\n",

"\u001b[?25hCollecting scipy>=1.10.0\n",

" Downloading scipy-1.14.0-cp310-cp310-macosx_14_0_arm64.whl (23.1 MB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m23.1/23.1 MB\u001b[0m \u001b[31m15.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m00:01\u001b[0m\n",

"\u001b[?25hRequirement already satisfied: numpy in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from milvus-model>=0.1.0->pymilvus[model]) (2.0.0)\n",

"Requirement already satisfied: pytz>=2020.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pandas>=1.2.4->pymilvus[model]) (2024.1)\n",

"Requirement already satisfied: python-dateutil>=2.8.2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pandas>=1.2.4->pymilvus[model]) (2.9.0.post0)\n",

"Requirement already satisfied: tzdata>=2022.7 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pandas>=1.2.4->pymilvus[model]) (2024.1)\n",

"Requirement already satisfied: packaging>=17.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from marshmallow>=3.0.0->environs<=9.5.0->pymilvus[model]) (24.1)\n",

"Requirement already satisfied: six>=1.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from python-dateutil>=2.8.2->pandas>=1.2.4->pymilvus[model]) (1.16.0)\n",

"Requirement already satisfied: filelock in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (3.15.4)\n",

"Requirement already satisfied: huggingface-hub<1.0,>=0.23.2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (0.24.0)\n",

"Requirement already satisfied: regex!=2019.12.17 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (2024.5.15)\n",

"Requirement already satisfied: pyyaml>=5.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (6.0.1)\n",

"Requirement already satisfied: tokenizers<0.20,>=0.19 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (0.19.1)\n",

"Requirement already satisfied: requests in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (2.32.3)\n",

"Collecting safetensors>=0.4.1\n",

" Using cached safetensors-0.4.3-cp310-cp310-macosx_11_0_arm64.whl (410 kB)\n",

"Collecting coloredlogs\n",

" Using cached coloredlogs-15.0.1-py2.py3-none-any.whl (46 kB)\n",

"Collecting numpy\n",

" Using cached numpy-1.26.4-cp310-cp310-macosx_11_0_arm64.whl (14.0 MB)\n",

"Collecting sympy\n",

" Downloading sympy-1.13.1-py3-none-any.whl (6.2 MB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m6.2/6.2 MB\u001b[0m \u001b[31m16.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m00:01\u001b[0m\n",

"\u001b[?25hCollecting flatbuffers\n",

" Using cached flatbuffers-24.3.25-py2.py3-none-any.whl (26 kB)\n",

"Requirement already satisfied: fsspec>=2023.5.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.23.2->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (2024.6.1)\n",

"Requirement already satisfied: typing-extensions>=3.7.4.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.23.2->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (4.12.2)\n",

"Collecting humanfriendly>=9.1\n",

" Using cached humanfriendly-10.0-py2.py3-none-any.whl (86 kB)\n",

"Requirement already satisfied: idna<4,>=2.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (3.7)\n",

"Requirement already satisfied: urllib3<3,>=1.21.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (2.0.7)\n",

"Requirement already satisfied: certifi>=2017.4.17 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (2024.7.4)\n",

"Requirement already satisfied: charset-normalizer<4,>=2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (3.3.2)\n",

"Collecting mpmath<1.4,>=1.1.0\n",

" Using cached mpmath-1.3.0-py3-none-any.whl (536 kB)\n",

"Installing collected packages: mpmath, flatbuffers, sympy, safetensors, numpy, humanfriendly, scipy, coloredlogs, onnxruntime, transformers, milvus-model\n",

" Attempting uninstall: numpy\n",

" Found existing installation: numpy 2.0.0\n",

" Uninstalling numpy-2.0.0:\n",

" Successfully uninstalled numpy-2.0.0\n",

"Successfully installed coloredlogs-15.0.1 flatbuffers-24.3.25 humanfriendly-10.0 milvus-model-0.2.3 mpmath-1.3.0 numpy-1.26.4 onnxruntime-1.18.1 safetensors-0.4.3 scipy-1.14.0 sympy-1.13.1 transformers-4.43.2\n",

"\n",

"\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip is available: \u001b[0m\u001b[31;49m23.0.1\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m24.1.2\u001b[0m\n",

"\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpip install --upgrade pip\u001b[0m\n"

]

}

],

"source": [

"!pip install \"pymilvus[model]\""

]

"cell_type": "code",

"execution_count": 4,

"metadata": {},

"outputs": [

{

"name": "stdout",

"output_type": "stream",

"text": [

"Requirement already satisfied: pymilvus[model] in /Users/gyliu/pr-agent/lib/python3.10/site-packages (2.4.4)\n",

"Requirement already satisfied: protobuf>=3.20.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (4.25.3)\n",

"Requirement already satisfied: pandas>=1.2.4 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (2.2.2)\n",

"Requirement already satisfied: environs<=9.5.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (9.5.0)\n",

"Requirement already satisfied: grpcio<=1.63.0,>=1.49.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (1.63.0)\n",

"Requirement already satisfied: ujson>=2.0.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (5.8.0)\n",

"Requirement already satisfied: setuptools>=67 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (71.1.0)\n",

"Requirement already satisfied: milvus-lite<2.5.0,>=2.4.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pymilvus[model]) (2.4.8)\n",

"Collecting milvus-model>=0.1.0\n",

" Downloading milvus_model-0.2.3-py3-none-any.whl (29 kB)\n",

"Requirement already satisfied: marshmallow>=3.0.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from environs<=9.5.0->pymilvus[model]) (3.21.3)\n",

"Requirement already satisfied: python-dotenv in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from environs<=9.5.0->pymilvus[model]) (1.0.1)\n",

"Requirement already satisfied: tqdm in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from milvus-lite<2.5.0,>=2.4.0->pymilvus[model]) (4.66.4)\n",

"Collecting transformers>=4.36.0\n",

" Downloading transformers-4.43.2-py3-none-any.whl (9.4 MB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m9.4/9.4 MB\u001b[0m \u001b[31m15.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0ma \u001b[36m0:00:01\u001b[0m\n",

"\u001b[?25hCollecting onnxruntime\n",

" Downloading onnxruntime-1.18.1-cp310-cp310-macosx_11_0_universal2.whl (15.9 MB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m15.9/15.9 MB\u001b[0m \u001b[31m16.1 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m00:01\u001b[0m\n",

"\u001b[?25hCollecting scipy>=1.10.0\n",

" Downloading scipy-1.14.0-cp310-cp310-macosx_14_0_arm64.whl (23.1 MB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m23.1/23.1 MB\u001b[0m \u001b[31m15.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m00:01\u001b[0m\n",

"\u001b[?25hRequirement already satisfied: numpy in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from milvus-model>=0.1.0->pymilvus[model]) (2.0.0)\n",

"Requirement already satisfied: pytz>=2020.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pandas>=1.2.4->pymilvus[model]) (2024.1)\n",

"Requirement already satisfied: python-dateutil>=2.8.2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pandas>=1.2.4->pymilvus[model]) (2.9.0.post0)\n",

"Requirement already satisfied: tzdata>=2022.7 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pandas>=1.2.4->pymilvus[model]) (2024.1)\n",

"Requirement already satisfied: packaging>=17.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from marshmallow>=3.0.0->environs<=9.5.0->pymilvus[model]) (24.1)\n",

"Requirement already satisfied: six>=1.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from python-dateutil>=2.8.2->pandas>=1.2.4->pymilvus[model]) (1.16.0)\n",

"Requirement already satisfied: filelock in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (3.15.4)\n",

"Requirement already satisfied: huggingface-hub<1.0,>=0.23.2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (0.24.0)\n",

"Requirement already satisfied: regex!=2019.12.17 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (2024.5.15)\n",

"Requirement already satisfied: pyyaml>=5.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (6.0.1)\n",

"Requirement already satisfied: tokenizers<0.20,>=0.19 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (0.19.1)\n",

"Requirement already satisfied: requests in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (2.32.3)\n",

"Collecting safetensors>=0.4.1\n",

" Using cached safetensors-0.4.3-cp310-cp310-macosx_11_0_arm64.whl (410 kB)\n",

"Collecting coloredlogs\n",

" Using cached coloredlogs-15.0.1-py2.py3-none-any.whl (46 kB)\n",

"Collecting numpy\n",

" Using cached numpy-1.26.4-cp310-cp310-macosx_11_0_arm64.whl (14.0 MB)\n",

"Collecting sympy\n",

" Downloading sympy-1.13.1-py3-none-any.whl (6.2 MB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m6.2/6.2 MB\u001b[0m \u001b[31m16.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m00:01\u001b[0m\n",

"\u001b[?25hCollecting flatbuffers\n",

" Using cached flatbuffers-24.3.25-py2.py3-none-any.whl (26 kB)\n",

"Requirement already satisfied: fsspec>=2023.5.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.23.2->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (2024.6.1)\n",

"Requirement already satisfied: typing-extensions>=3.7.4.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.23.2->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (4.12.2)\n",

"Collecting humanfriendly>=9.1\n",

" Using cached humanfriendly-10.0-py2.py3-none-any.whl (86 kB)\n",

"Requirement already satisfied: idna<4,>=2.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (3.7)\n",

"Requirement already satisfied: urllib3<3,>=1.21.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (2.0.7)\n",

"Requirement already satisfied: certifi>=2017.4.17 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (2024.7.4)\n",

"Requirement already satisfied: charset-normalizer<4,>=2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests->transformers>=4.36.0->milvus-model>=0.1.0->pymilvus[model]) (3.3.2)\n",

"Collecting mpmath<1.4,>=1.1.0\n",

" Using cached mpmath-1.3.0-py3-none-any.whl (536 kB)\n",

"Installing collected packages: mpmath, flatbuffers, sympy, safetensors, numpy, humanfriendly, scipy, coloredlogs, onnxruntime, transformers, milvus-model\n",

" Attempting uninstall: numpy\n",

" Found existing installation: numpy 2.0.0\n",

" Uninstalling numpy-2.0.0:\n",

" Successfully uninstalled numpy-2.0.0\n",

"Successfully installed coloredlogs-15.0.1 flatbuffers-24.3.25 humanfriendly-10.0 milvus-model-0.2.3 mpmath-1.3.0 numpy-1.26.4 onnxruntime-1.18.1 safetensors-0.4.3 scipy-1.14.0 sympy-1.13.1 transformers-4.43.2\n",

"\n",

"\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip is available: \u001b[0m\u001b[31;49m23.0.1\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m24.1.2\u001b[0m\n",

"\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpip install --upgrade pip\u001b[0m\n"

]

}

],

"source": [

"!pip install \"pymilvus[model]\" > /dev/null\n",

"!pip install --upgrade pip > /dev/null"

]

coderabbitai · 2024-07-25T20:06:46Z

milvus/milvus.ipynb

+      "Requirement already satisfied: idna>=2.8 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from anyio>=3.1.0->jupyter-server<3,>=2.4.0->notebook->jupyter) (3.7)\n",
+      "Requirement already satisfied: sniffio>=1.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from anyio>=3.1.0->jupyter-server<3,>=2.4.0->notebook->jupyter) (1.3.1)\n",
+      "Collecting argon2-cffi-bindings\n",
+      "  Downloading argon2_cffi_bindings-21.2.0-cp38-abi3-macosx_10_9_universal2.whl (53 kB)\n",
+      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m53.1/53.1 kB\u001b[0m \u001b[31m6.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
+      "\u001b[?25hRequirement already satisfied: httpcore==1.* in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from httpx>=0.25.0->jupyterlab<4.3,>=4.2.0->notebook->jupyter) (1.0.5)\n",
+      "Requirement already satisfied: certifi in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from httpx>=0.25.0->jupyterlab<4.3,>=4.2.0->notebook->jupyter) (2024.7.4)\n",
+      "Requirement already satisfied: h11<0.15,>=0.13 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from httpcore==1.*->httpx>=0.25.0->jupyterlab<4.3,>=4.2.0->notebook->jupyter) (0.14.0)\n",
+      "Requirement already satisfied: parso<0.9.0,>=0.8.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jedi>=0.16->ipython>=7.23.1->ipykernel->jupyter) (0.8.4)\n",
+      "Collecting rpds-py>=0.7.1\n",
+      "  Downloading rpds_py-0.19.1-cp310-cp310-macosx_11_0_arm64.whl (310 kB)\n",
+      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m310.4/310.4 kB\u001b[0m \u001b[31m14.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
+      "\u001b[?25hRequirement already satisfied: attrs>=22.2.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jsonschema>=4.18.0->jupyterlab-server<3,>=2.27.1->notebook->jupyter) (23.2.0)\n",
+      "Collecting referencing>=0.28.4\n",
+      "  Using cached referencing-0.35.1-py3-none-any.whl (26 kB)\n",
+      "Collecting jsonschema-specifications>=2023.03.6\n",
+      "  Using cached jsonschema_specifications-2023.12.1-py3-none-any.whl (18 kB)\n",
+      "Requirement already satisfied: pyyaml>=5.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter) (6.0.1)\n",
+      "Collecting rfc3986-validator>=0.1.1\n",
+      "  Downloading rfc3986_validator-0.1.1-py2.py3-none-any.whl (4.2 kB)\n",
+      "Collecting python-json-logger>=2.0.4\n",
+      "  Downloading python_json_logger-2.0.7-py3-none-any.whl (8.1 kB)\n",
+      "Collecting rfc3339-validator\n",
+      "  Downloading rfc3339_validator-0.1.4-py2.py3-none-any.whl (3.5 kB)\n",
+      "Requirement already satisfied: ptyprocess>=0.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pexpect>4.3->ipython>=7.23.1->ipykernel->jupyter) (0.7.0)\n",
+      "Requirement already satisfied: urllib3<3,>=1.21.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests>=2.31->jupyterlab-server<3,>=2.27.1->notebook->jupyter) (2.0.7)\n",
+      "Requirement already satisfied: charset-normalizer<4,>=2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests>=2.31->jupyterlab-server<3,>=2.27.1->notebook->jupyter) (3.3.2)\n",
+      "Requirement already satisfied: pure-eval in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=7.23.1->ipykernel->jupyter) (0.2.3)\n",
+      "Requirement already satisfied: executing>=1.2.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=7.23.1->ipykernel->jupyter) (2.0.1)\n",
+      "Requirement already satisfied: asttokens>=2.1.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=7.23.1->ipykernel->jupyter) (2.4.1)\n",
+      "Collecting jsonpointer>1.13\n",
+      "  Using cached jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB)\n",
+      "Collecting fqdn\n",
+      "  Downloading fqdn-1.5.1-py3-none-any.whl (9.1 kB)\n",
+      "Collecting webcolors>=24.6.0\n",
+      "  Downloading webcolors-24.6.0-py3-none-any.whl (14 kB)\n",
+      "Collecting uri-template\n",
+      "  Downloading uri_template-1.3.0-py3-none-any.whl (11 kB)\n",
+      "Collecting isoduration\n",
+      "  Downloading isoduration-20.11.0-py3-none-any.whl (11 kB)\n",
+      "Requirement already satisfied: cffi>=1.0.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from argon2-cffi-bindings->argon2-cffi>=21.1->jupyter-server<3,>=2.4.0->notebook->jupyter) (1.16.0)\n",
+      "Requirement already satisfied: pycparser in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from cffi>=1.0.1->argon2-cffi-bindings->argon2-cffi>=21.1->jupyter-server<3,>=2.4.0->notebook->jupyter) (2.22)\n",
+      "Collecting arrow>=0.15.0\n",
+      "  Downloading arrow-1.3.0-py3-none-any.whl (66 kB)\n",
+      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m66.4/66.4 kB\u001b[0m \u001b[31m8.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
+      "\u001b[?25hCollecting types-python-dateutil>=2.8.10\n",
+      "  Downloading types_python_dateutil-2.9.0.20240316-py3-none-any.whl (9.7 kB)\n",
+      "Installing collected packages: webencodings, fastjsonschema, widgetsnbextension, websocket-client, webcolors, uri-template, types-python-dateutil, tinycss2, terminado, soupsieve, send2trash, rpds-py, rfc3986-validator, rfc3339-validator, qtpy, python-json-logger, prometheus-client, pandocfilters, overrides, mistune, jupyterlab-widgets, jupyterlab-pygments, jsonpointer, json5, fqdn, defusedxml, bleach, babel, async-lru, referencing, jupyter-server-terminals, beautifulsoup4, arrow, argon2-cffi-bindings, jsonschema-specifications, isoduration, argon2-cffi, jsonschema, ipywidgets, qtconsole, nbformat, jupyter-console, nbclient, jupyter-events, nbconvert, jupyter-server, notebook-shim, jupyterlab-server, jupyter-lsp, jupyterlab, notebook, jupyter\n",
+      "Successfully installed argon2-cffi-23.1.0 argon2-cffi-bindings-21.2.0 arrow-1.3.0 async-lru-2.0.4 babel-2.15.0 beautifulsoup4-4.12.3 bleach-6.1.0 defusedxml-0.7.1 fastjsonschema-2.20.0 fqdn-1.5.1 ipywidgets-8.1.3 isoduration-20.11.0 json5-0.9.25 jsonpointer-3.0.0 jsonschema-4.23.0 jsonschema-specifications-2023.12.1 jupyter-1.0.0 jupyter-console-6.6.3 jupyter-events-0.10.0 jupyter-lsp-2.2.5 jupyter-server-2.14.2 jupyter-server-terminals-0.5.3 jupyterlab-4.2.4 jupyterlab-pygments-0.3.0 jupyterlab-server-2.27.3 jupyterlab-widgets-3.0.11 mistune-3.0.2 nbclient-0.10.0 nbconvert-7.16.4 nbformat-5.10.4 notebook-7.2.1 notebook-shim-0.2.4 overrides-7.7.0 pandocfilters-1.5.1 prometheus-client-0.20.0 python-json-logger-2.0.7 qtconsole-5.5.2 qtpy-2.4.1 referencing-0.35.1 rfc3339-validator-0.1.4 rfc3986-validator-0.1.1 rpds-py-0.19.1 send2trash-1.8.3 soupsieve-2.5 terminado-0.18.1 tinycss2-1.3.0 types-python-dateutil-2.9.0.20240316 uri-template-1.3.0 webcolors-24.6.0 webencodings-0.5.1 websocket-client-1.8.0 widgetsnbextension-4.0.11\n",
+      "\n",
+      "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip is available: \u001b[0m\u001b[31;49m23.0.1\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m24.1.2\u001b[0m\n",
+      "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpip install --upgrade pip\u001b[0m\n"
+     ]
+    },
+    {
+     "name": "stderr",
+     "output_type": "stream",
+     "text": [
+      "huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...\n",
+      "To disable this warning, you can either:\n",
+      "\t- Avoid using `tokenizers` before the fork if possible\n",
+      "\t- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)\n"
+     ]
+    },
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "Requirement already satisfied: ipywidgets in /Users/gyliu/pr-agent/lib/python3.10/site-packages (8.1.3)\n",
+      "Requirement already satisfied: jupyterlab-widgets~=3.0.11 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipywidgets) (3.0.11)\n",
+      "Requirement already satisfied: comm>=0.1.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipywidgets) (0.2.2)\n",
+      "Requirement already satisfied: ipython>=6.1.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipywidgets) (8.26.0)\n",
+      "Requirement already satisfied: widgetsnbextension~=4.0.11 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipywidgets) (4.0.11)\n",
+      "Requirement already satisfied: traitlets>=4.3.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipywidgets) (5.14.3)\n",
+      "Requirement already satisfied: exceptiongroup in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (1.2.2)\n",
+      "Requirement already satisfied: pygments>=2.4.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (2.18.0)\n",
+      "Requirement already satisfied: jedi>=0.16 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (0.19.1)\n",
+      "Requirement already satisfied: stack-data in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (0.6.3)\n",
+      "Requirement already satisfied: typing-extensions>=4.6 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (4.12.2)\n",
+      "Requirement already satisfied: decorator in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (5.1.1)\n",
+      "Requirement already satisfied: matplotlib-inline in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (0.1.7)\n",
+      "Requirement already satisfied: prompt-toolkit<3.1.0,>=3.0.41 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (3.0.47)\n",
+      "Requirement already satisfied: pexpect>4.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (4.9.0)\n",
+      "Requirement already satisfied: parso<0.9.0,>=0.8.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jedi>=0.16->ipython>=6.1.0->ipywidgets) (0.8.4)\n",
+      "Requirement already satisfied: ptyprocess>=0.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pexpect>4.3->ipython>=6.1.0->ipywidgets) (0.7.0)\n",
+      "Requirement already satisfied: wcwidth in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from prompt-toolkit<3.1.0,>=3.0.41->ipython>=6.1.0->ipywidgets) (0.2.13)\n",
+      "Requirement already satisfied: executing>=1.2.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=6.1.0->ipywidgets) (2.0.1)\n",
+      "Requirement already satisfied: pure-eval in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=6.1.0->ipywidgets) (0.2.3)\n",
+      "Requirement already satisfied: asttokens>=2.1.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=6.1.0->ipywidgets) (2.4.1)\n",
+      "Requirement already satisfied: six>=1.12.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from asttokens>=2.1.0->stack-data->ipython>=6.1.0->ipywidgets) (1.16.0)\n",
+      "\n",
+      "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip is available: \u001b[0m\u001b[31;49m23.0.1\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m24.1.2\u001b[0m\n",
+      "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpip install --upgrade pip\u001b[0m\n"
+     ]
+    }
+   ],
+   "source": [
+    "!pip install --upgrade jupyter\n",
+    "!pip install --upgrade ipywidgets"
+   ]


Minimize installation output logs and upgrade pip.

The output logs from the installation command are included, which can be minimized for readability. Additionally, consider upgrading pip to avoid the notice messages.

- !pip install --upgrade jupyter - !pip install --upgrade ipywidgets + !pip install --upgrade jupyter > /dev/null + !pip install --upgrade ipywidgets > /dev/null + !pip install --upgrade pip > /dev/null

Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change

"cell_type": "code",

"execution_count": 6,

"metadata": {},

"outputs": [

{

"name": "stderr",

"output_type": "stream",

"text": [

"huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...\n",

"To disable this warning, you can either:\n",

"\t- Avoid using `tokenizers` before the fork if possible\n",

"\t- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)\n"

]

},

{

"name": "stdout",

"output_type": "stream",

"text": [

"Collecting jupyter\n",

" Downloading jupyter-1.0.0-py2.py3-none-any.whl (2.7 kB)\n",

"Collecting jupyter-console\n",

" Downloading jupyter_console-6.6.3-py3-none-any.whl (24 kB)\n",

"Collecting notebook\n",

" Downloading notebook-7.2.1-py3-none-any.whl (5.0 MB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m5.0/5.0 MB\u001b[0m \u001b[31m12.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m00:01\u001b[0m\n",

"\u001b[?25hCollecting nbconvert\n",

" Downloading nbconvert-7.16.4-py3-none-any.whl (257 kB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m257.4/257.4 kB\u001b[0m \u001b[31m10.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",

"\u001b[?25hCollecting qtconsole\n",

" Downloading qtconsole-5.5.2-py3-none-any.whl (123 kB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m123.4/123.4 kB\u001b[0m \u001b[31m6.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",

"\u001b[?25hRequirement already satisfied: ipykernel in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyter) (6.29.5)\n",

"Collecting ipywidgets\n",

" Downloading ipywidgets-8.1.3-py3-none-any.whl (139 kB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m139.4/139.4 kB\u001b[0m \u001b[31m6.9 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",

"\u001b[?25hRequirement already satisfied: traitlets>=5.4.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (5.14.3)\n",

"Requirement already satisfied: pyzmq>=24 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (26.0.3)\n",

"Requirement already satisfied: packaging in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (24.1)\n",

"Requirement already satisfied: psutil in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (6.0.0)\n",

"Requirement already satisfied: comm>=0.1.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (0.2.2)\n",

"Requirement already satisfied: nest-asyncio in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (1.6.0)\n",

"Requirement already satisfied: matplotlib-inline>=0.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (0.1.7)\n",

"Requirement already satisfied: ipython>=7.23.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (8.26.0)\n",

"Requirement already satisfied: tornado>=6.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (6.4.1)\n",

"Requirement already satisfied: jupyter-core!=5.0.*,>=4.12 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (5.7.2)\n",

"Requirement already satisfied: debugpy>=1.6.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (1.8.2)\n",

"Requirement already satisfied: jupyter-client>=6.1.12 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (8.6.2)\n",

"Requirement already satisfied: appnope in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (0.1.4)\n",

"Collecting jupyterlab-widgets~=3.0.11\n",

" Downloading jupyterlab_widgets-3.0.11-py3-none-any.whl (214 kB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m214.4/214.4 kB\u001b[0m \u001b[31m10.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",

"\u001b[?25hCollecting widgetsnbextension~=4.0.11\n",

" Downloading widgetsnbextension-4.0.11-py3-none-any.whl (2.3 MB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m2.3/2.3 MB\u001b[0m \u001b[31m15.8 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0ma \u001b[36m0:00:01\u001b[0m\n",

"\u001b[?25hRequirement already satisfied: pygments in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyter-console->jupyter) (2.18.0)\n",

"Requirement already satisfied: prompt-toolkit>=3.0.30 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyter-console->jupyter) (3.0.47)\n",

"Collecting defusedxml\n",

" Downloading defusedxml-0.7.1-py2.py3-none-any.whl (25 kB)\n",

"Collecting jupyterlab-pygments\n",

" Downloading jupyterlab_pygments-0.3.0-py3-none-any.whl (15 kB)\n",

"Collecting tinycss2\n",

" Downloading tinycss2-1.3.0-py3-none-any.whl (22 kB)\n",

"Collecting mistune<4,>=2.0.3\n",

" Downloading mistune-3.0.2-py3-none-any.whl (47 kB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m48.0/48.0 kB\u001b[0m \u001b[31m7.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",

"\u001b[?25hRequirement already satisfied: markupsafe>=2.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from nbconvert->jupyter) (2.1.5)\n",

"Collecting pandocfilters>=1.4.1\n",

" Downloading pandocfilters-1.5.1-py2.py3-none-any.whl (8.7 kB)\n",

"Collecting nbformat>=5.7\n",

" Downloading nbformat-5.10.4-py3-none-any.whl (78 kB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m78.5/78.5 kB\u001b[0m \u001b[31m9.1 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",

"\u001b[?25hCollecting beautifulsoup4\n",

" Using cached beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)\n",

"Collecting bleach!=5.0.0\n",

" Downloading bleach-6.1.0-py3-none-any.whl (162 kB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m162.8/162.8 kB\u001b[0m \u001b[31m9.7 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",

"\u001b[?25hRequirement already satisfied: jinja2>=3.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from nbconvert->jupyter) (3.1.2)\n",

"Collecting nbclient>=0.5.0\n",

" Downloading nbclient-0.10.0-py3-none-any.whl (25 kB)\n",

"Collecting jupyter-server<3,>=2.4.0\n",

" Downloading jupyter_server-2.14.2-py3-none-any.whl (383 kB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m383.6/383.6 kB\u001b[0m \u001b[31m12.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",

"\u001b[?25hCollecting notebook-shim<0.3,>=0.2\n",

" Downloading notebook_shim-0.2.4-py3-none-any.whl (13 kB)\n",

"Collecting jupyterlab-server<3,>=2.27.1\n",

" Downloading jupyterlab_server-2.27.3-py3-none-any.whl (59 kB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m59.7/59.7 kB\u001b[0m \u001b[31m7.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",

"\u001b[?25hCollecting jupyterlab<4.3,>=4.2.0\n",

" Downloading jupyterlab-4.2.4-py3-none-any.whl (11.6 MB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m11.6/11.6 MB\u001b[0m \u001b[31m16.4 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m00:01\u001b[0m\n",

"\u001b[?25hCollecting qtpy>=2.4.0\n",

" Downloading QtPy-2.4.1-py3-none-any.whl (93 kB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m93.5/93.5 kB\u001b[0m \u001b[31m8.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",

"\u001b[?25hRequirement already satisfied: six>=1.9.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from bleach!=5.0.0->nbconvert->jupyter) (1.16.0)\n",

"Collecting webencodings\n",

" Downloading webencodings-0.5.1-py2.py3-none-any.whl (11 kB)\n",

"Requirement already satisfied: pexpect>4.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=7.23.1->ipykernel->jupyter) (4.9.0)\n",

"Requirement already satisfied: exceptiongroup in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=7.23.1->ipykernel->jupyter) (1.2.2)\n",

"Requirement already satisfied: typing-extensions>=4.6 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=7.23.1->ipykernel->jupyter) (4.12.2)\n",

"Requirement already satisfied: jedi>=0.16 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=7.23.1->ipykernel->jupyter) (0.19.1)\n",

"Requirement already satisfied: stack-data in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=7.23.1->ipykernel->jupyter) (0.6.3)\n",

"Requirement already satisfied: decorator in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=7.23.1->ipykernel->jupyter) (5.1.1)\n",

"Requirement already satisfied: python-dateutil>=2.8.2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyter-client>=6.1.12->ipykernel->jupyter) (2.9.0.post0)\n",

"Requirement already satisfied: platformdirs>=2.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyter-core!=5.0.*,>=4.12->ipykernel->jupyter) (4.2.2)\n",

"Collecting jupyter-server-terminals>=0.4.4\n",

" Downloading jupyter_server_terminals-0.5.3-py3-none-any.whl (13 kB)\n",

"Collecting terminado>=0.8.3\n",

" Downloading terminado-0.18.1-py3-none-any.whl (14 kB)\n",

"Collecting prometheus-client>=0.9\n",

" Using cached prometheus_client-0.20.0-py3-none-any.whl (54 kB)\n",

"Collecting send2trash>=1.8.2\n",

" Downloading Send2Trash-1.8.3-py3-none-any.whl (18 kB)\n",

"Collecting websocket-client>=1.7\n",

" Using cached websocket_client-1.8.0-py3-none-any.whl (58 kB)\n",

"Collecting jupyter-events>=0.9.0\n",

" Downloading jupyter_events-0.10.0-py3-none-any.whl (18 kB)\n",

"Collecting overrides>=5.0\n",

" Using cached overrides-7.7.0-py3-none-any.whl (17 kB)\n",

"Requirement already satisfied: anyio>=3.1.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyter-server<3,>=2.4.0->notebook->jupyter) (4.4.0)\n",

"Collecting argon2-cffi>=21.1\n",

" Downloading argon2_cffi-23.1.0-py3-none-any.whl (15 kB)\n",

"Requirement already satisfied: httpx>=0.25.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyterlab<4.3,>=4.2.0->notebook->jupyter) (0.27.0)\n",

"Requirement already satisfied: tomli>=1.2.2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyterlab<4.3,>=4.2.0->notebook->jupyter) (2.0.1)\n",

"Collecting jupyter-lsp>=2.0.0\n",

" Downloading jupyter_lsp-2.2.5-py3-none-any.whl (69 kB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m69.1/69.1 kB\u001b[0m \u001b[31m9.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",

"\u001b[?25hCollecting async-lru>=1.0.0\n",

" Downloading async_lru-2.0.4-py3-none-any.whl (6.1 kB)\n",

"Requirement already satisfied: setuptools>=40.1.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyterlab<4.3,>=4.2.0->notebook->jupyter) (71.1.0)\n",

"Collecting jsonschema>=4.18.0\n",

" Using cached jsonschema-4.23.0-py3-none-any.whl (88 kB)\n",

"Collecting json5>=0.9.0\n",

" Downloading json5-0.9.25-py3-none-any.whl (30 kB)\n",

"Requirement already satisfied: requests>=2.31 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyterlab-server<3,>=2.27.1->notebook->jupyter) (2.32.3)\n",

"Collecting babel>=2.10\n",

" Using cached Babel-2.15.0-py3-none-any.whl (9.6 MB)\n",

"Collecting fastjsonschema>=2.15\n",

" Downloading fastjsonschema-2.20.0-py3-none-any.whl (23 kB)\n",

"Requirement already satisfied: wcwidth in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from prompt-toolkit>=3.0.30->jupyter-console->jupyter) (0.2.13)\n",

"Collecting soupsieve>1.2\n",

" Using cached soupsieve-2.5-py3-none-any.whl (36 kB)\n",

"Requirement already satisfied: idna>=2.8 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from anyio>=3.1.0->jupyter-server<3,>=2.4.0->notebook->jupyter) (3.7)\n",

"Requirement already satisfied: sniffio>=1.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from anyio>=3.1.0->jupyter-server<3,>=2.4.0->notebook->jupyter) (1.3.1)\n",

"Collecting argon2-cffi-bindings\n",

" Downloading argon2_cffi_bindings-21.2.0-cp38-abi3-macosx_10_9_universal2.whl (53 kB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m53.1/53.1 kB\u001b[0m \u001b[31m6.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",

"\u001b[?25hRequirement already satisfied: httpcore==1.* in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from httpx>=0.25.0->jupyterlab<4.3,>=4.2.0->notebook->jupyter) (1.0.5)\n",

"Requirement already satisfied: certifi in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from httpx>=0.25.0->jupyterlab<4.3,>=4.2.0->notebook->jupyter) (2024.7.4)\n",

"Requirement already satisfied: h11<0.15,>=0.13 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from httpcore==1.*->httpx>=0.25.0->jupyterlab<4.3,>=4.2.0->notebook->jupyter) (0.14.0)\n",

"Requirement already satisfied: parso<0.9.0,>=0.8.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jedi>=0.16->ipython>=7.23.1->ipykernel->jupyter) (0.8.4)\n",

"Collecting rpds-py>=0.7.1\n",

" Downloading rpds_py-0.19.1-cp310-cp310-macosx_11_0_arm64.whl (310 kB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m310.4/310.4 kB\u001b[0m \u001b[31m14.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",

"\u001b[?25hRequirement already satisfied: attrs>=22.2.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jsonschema>=4.18.0->jupyterlab-server<3,>=2.27.1->notebook->jupyter) (23.2.0)\n",

"Collecting referencing>=0.28.4\n",

" Using cached referencing-0.35.1-py3-none-any.whl (26 kB)\n",

"Collecting jsonschema-specifications>=2023.03.6\n",

" Using cached jsonschema_specifications-2023.12.1-py3-none-any.whl (18 kB)\n",

"Requirement already satisfied: pyyaml>=5.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter) (6.0.1)\n",

"Collecting rfc3986-validator>=0.1.1\n",

" Downloading rfc3986_validator-0.1.1-py2.py3-none-any.whl (4.2 kB)\n",

"Collecting python-json-logger>=2.0.4\n",

" Downloading python_json_logger-2.0.7-py3-none-any.whl (8.1 kB)\n",

"Collecting rfc3339-validator\n",

" Downloading rfc3339_validator-0.1.4-py2.py3-none-any.whl (3.5 kB)\n",

"Requirement already satisfied: ptyprocess>=0.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pexpect>4.3->ipython>=7.23.1->ipykernel->jupyter) (0.7.0)\n",

"Requirement already satisfied: urllib3<3,>=1.21.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests>=2.31->jupyterlab-server<3,>=2.27.1->notebook->jupyter) (2.0.7)\n",

"Requirement already satisfied: charset-normalizer<4,>=2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests>=2.31->jupyterlab-server<3,>=2.27.1->notebook->jupyter) (3.3.2)\n",

"Requirement already satisfied: pure-eval in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=7.23.1->ipykernel->jupyter) (0.2.3)\n",

"Requirement already satisfied: executing>=1.2.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=7.23.1->ipykernel->jupyter) (2.0.1)\n",

"Requirement already satisfied: asttokens>=2.1.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=7.23.1->ipykernel->jupyter) (2.4.1)\n",

"Collecting jsonpointer>1.13\n",

" Using cached jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB)\n",

"Collecting fqdn\n",

" Downloading fqdn-1.5.1-py3-none-any.whl (9.1 kB)\n",

"Collecting webcolors>=24.6.0\n",

" Downloading webcolors-24.6.0-py3-none-any.whl (14 kB)\n",

"Collecting uri-template\n",

" Downloading uri_template-1.3.0-py3-none-any.whl (11 kB)\n",

"Collecting isoduration\n",

" Downloading isoduration-20.11.0-py3-none-any.whl (11 kB)\n",

"Requirement already satisfied: cffi>=1.0.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from argon2-cffi-bindings->argon2-cffi>=21.1->jupyter-server<3,>=2.4.0->notebook->jupyter) (1.16.0)\n",

"Requirement already satisfied: pycparser in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from cffi>=1.0.1->argon2-cffi-bindings->argon2-cffi>=21.1->jupyter-server<3,>=2.4.0->notebook->jupyter) (2.22)\n",

"Collecting arrow>=0.15.0\n",

" Downloading arrow-1.3.0-py3-none-any.whl (66 kB)\n",

"\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m66.4/66.4 kB\u001b[0m \u001b[31m8.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",

"\u001b[?25hCollecting types-python-dateutil>=2.8.10\n",

" Downloading types_python_dateutil-2.9.0.20240316-py3-none-any.whl (9.7 kB)\n",

"Installing collected packages: webencodings, fastjsonschema, widgetsnbextension, websocket-client, webcolors, uri-template, types-python-dateutil, tinycss2, terminado, soupsieve, send2trash, rpds-py, rfc3986-validator, rfc3339-validator, qtpy, python-json-logger, prometheus-client, pandocfilters, overrides, mistune, jupyterlab-widgets, jupyterlab-pygments, jsonpointer, json5, fqdn, defusedxml, bleach, babel, async-lru, referencing, jupyter-server-terminals, beautifulsoup4, arrow, argon2-cffi-bindings, jsonschema-specifications, isoduration, argon2-cffi, jsonschema, ipywidgets, qtconsole, nbformat, jupyter-console, nbclient, jupyter-events, nbconvert, jupyter-server, notebook-shim, jupyterlab-server, jupyter-lsp, jupyterlab, notebook, jupyter\n",

"Successfully installed argon2-cffi-23.1.0 argon2-cffi-bindings-21.2.0 arrow-1.3.0 async-lru-2.0.4 babel-2.15.0 beautifulsoup4-4.12.3 bleach-6.1.0 defusedxml-0.7.1 fastjsonschema-2.20.0 fqdn-1.5.1 ipywidgets-8.1.3 isoduration-20.11.0 json5-0.9.25 jsonpointer-3.0.0 jsonschema-4.23.0 jsonschema-specifications-2023.12.1 jupyter-1.0.0 jupyter-console-6.6.3 jupyter-events-0.10.0 jupyter-lsp-2.2.5 jupyter-server-2.14.2 jupyter-server-terminals-0.5.3 jupyterlab-4.2.4 jupyterlab-pygments-0.3.0 jupyterlab-server-2.27.3 jupyterlab-widgets-3.0.11 mistune-3.0.2 nbclient-0.10.0 nbconvert-7.16.4 nbformat-5.10.4 notebook-7.2.1 notebook-shim-0.2.4 overrides-7.7.0 pandocfilters-1.5.1 prometheus-client-0.20.0 python-json-logger-2.0.7 qtconsole-5.5.2 qtpy-2.4.1 referencing-0.35.1 rfc3339-validator-0.1.4 rfc3986-validator-0.1.1 rpds-py-0.19.1 send2trash-1.8.3 soupsieve-2.5 terminado-0.18.1 tinycss2-1.3.0 types-python-dateutil-2.9.0.20240316 uri-template-1.3.0 webcolors-24.6.0 webencodings-0.5.1 websocket-client-1.8.0 widgetsnbextension-4.0.11\n",

"\n",

"\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip is available: \u001b[0m\u001b[31;49m23.0.1\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m24.1.2\u001b[0m\n",

"\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpip install --upgrade pip\u001b[0m\n"

]

},

{

"name": "stderr",

"output_type": "stream",

"text": [

"huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...\n",

"To disable this warning, you can either:\n",

"\t- Avoid using `tokenizers` before the fork if possible\n",

"\t- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)\n"

]

},

{

"name": "stdout",

"output_type": "stream",

"text": [

"Requirement already satisfied: ipywidgets in /Users/gyliu/pr-agent/lib/python3.10/site-packages (8.1.3)\n",

"Requirement already satisfied: jupyterlab-widgets~=3.0.11 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipywidgets) (3.0.11)\n",

"Requirement already satisfied: comm>=0.1.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipywidgets) (0.2.2)\n",

"Requirement already satisfied: ipython>=6.1.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipywidgets) (8.26.0)\n",

"Requirement already satisfied: widgetsnbextension~=4.0.11 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipywidgets) (4.0.11)\n",

"Requirement already satisfied: traitlets>=4.3.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipywidgets) (5.14.3)\n",

"Requirement already satisfied: exceptiongroup in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (1.2.2)\n",

"Requirement already satisfied: pygments>=2.4.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (2.18.0)\n",

"Requirement already satisfied: jedi>=0.16 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (0.19.1)\n",

"Requirement already satisfied: stack-data in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (0.6.3)\n",

"Requirement already satisfied: typing-extensions>=4.6 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (4.12.2)\n",

"Requirement already satisfied: decorator in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (5.1.1)\n",

"Requirement already satisfied: matplotlib-inline in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (0.1.7)\n",

"Requirement already satisfied: prompt-toolkit<3.1.0,>=3.0.41 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (3.0.47)\n",

"Requirement already satisfied: pexpect>4.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (4.9.0)\n",

"Requirement already satisfied: parso<0.9.0,>=0.8.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jedi>=0.16->ipython>=6.1.0->ipywidgets) (0.8.4)\n",

"Requirement already satisfied: ptyprocess>=0.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pexpect>4.3->ipython>=6.1.0->ipywidgets) (0.7.0)\n",

"Requirement already satisfied: wcwidth in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from prompt-toolkit<3.1.0,>=3.0.41->ipython>=6.1.0->ipywidgets) (0.2.13)\n",

"Requirement already satisfied: executing>=1.2.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=6.1.0->ipywidgets) (2.0.1)\n",

"Requirement already satisfied: pure-eval in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=6.1.0->ipywidgets) (0.2.3)\n",

"Requirement already satisfied: asttokens>=2.1.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=6.1.0->ipywidgets) (2.4.1)\n",

"Requirement already satisfied: six>=1.12.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from asttokens>=2.1.0->stack-data->ipython>=6.1.0->ipywidgets) (1.16.0)\n",

"\n",

"\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip is available: \u001b[0m\u001b[31;49m23.0.1\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m24.1.2\u001b[0m\n",

"\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpip install --upgrade pip\u001b[0m\n"

]

}

],

"source": [

"!pip install --upgrade jupyter\n",

"!pip install --upgrade ipywidgets"

]

coderabbitai · 2024-07-25T20:06:46Z

milvus/milvus.ipynb

+   "cell_type": "code",
+   "execution_count": 8,
+   "metadata": {},
+   "outputs": [
+    {
+     "ename": "TypeError",
+     "evalue": "",
+     "output_type": "error",
+     "traceback": [
+      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
+      "\u001b[0;31mTypeError\u001b[0m                                 Traceback (most recent call last)",
+      "Cell \u001b[0;32mIn[8], line 12\u001b[0m\n\u001b[1;32m      4\u001b[0m embedding_fn \u001b[38;5;241m=\u001b[39m model\u001b[38;5;241m.\u001b[39mDefaultEmbeddingFunction()\n\u001b[1;32m      6\u001b[0m docs \u001b[38;5;241m=\u001b[39m [\n\u001b[1;32m      7\u001b[0m     \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mArtificial intelligence was founded as an academic discipline in 1956.\u001b[39m\u001b[38;5;124m\"\u001b[39m,\n\u001b[1;32m      8\u001b[0m     \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mAlan Turing was the first person to conduct substantial research in AI.\u001b[39m\u001b[38;5;124m\"\u001b[39m,\n\u001b[1;32m      9\u001b[0m     \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mBorn in Maida Vale, London, Turing was raised in southern England.\u001b[39m\u001b[38;5;124m\"\u001b[39m,\n\u001b[1;32m     10\u001b[0m ]\n\u001b[0;32m---> 12\u001b[0m vectors \u001b[38;5;241m=\u001b[39m \u001b[43membedding_fn\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mencode_documents\u001b[49m\u001b[43m(\u001b[49m\u001b[43mdocs\u001b[49m\u001b[43m)\u001b[49m\n\u001b[1;32m     13\u001b[0m \u001b[38;5;28mprint\u001b[39m(\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mDim:\u001b[39m\u001b[38;5;124m\"\u001b[39m, embedding_fn\u001b[38;5;241m.\u001b[39mdim, vectors[\u001b[38;5;241m0\u001b[39m]\u001b[38;5;241m.\u001b[39mshape)  \u001b[38;5;66;03m# Dim: 768 (768,)\u001b[39;00m\n\u001b[1;32m     15\u001b[0m data \u001b[38;5;241m=\u001b[39m [\n\u001b[1;32m     16\u001b[0m     {\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mid\u001b[39m\u001b[38;5;124m\"\u001b[39m: i, \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mvector\u001b[39m\u001b[38;5;124m\"\u001b[39m: vectors[i], \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mtext\u001b[39m\u001b[38;5;124m\"\u001b[39m: docs[i], \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124msubject\u001b[39m\u001b[38;5;124m\"\u001b[39m: \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mhistory\u001b[39m\u001b[38;5;124m\"\u001b[39m}\n\u001b[1;32m     17\u001b[0m     \u001b[38;5;28;01mfor\u001b[39;00m i \u001b[38;5;129;01min\u001b[39;00m \u001b[38;5;28mrange\u001b[39m(\u001b[38;5;28mlen\u001b[39m(vectors))\n\u001b[1;32m     18\u001b[0m ]\n",
+      "File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/milvus_model/dense/onnx.py:29\u001b[0m, in \u001b[0;36mOnnxEmbeddingFunction.encode_documents\u001b[0;34m(self, documents)\u001b[0m\n\u001b[1;32m     28\u001b[0m \u001b[38;5;28;01mdef\u001b[39;00m \u001b[38;5;21mencode_documents\u001b[39m(\u001b[38;5;28mself\u001b[39m, documents: List[\u001b[38;5;28mstr\u001b[39m]) \u001b[38;5;241m-\u001b[39m\u001b[38;5;241m>\u001b[39m List[np\u001b[38;5;241m.\u001b[39marray]:\n\u001b[0;32m---> 29\u001b[0m     \u001b[38;5;28;01mreturn\u001b[39;00m \u001b[38;5;28;43mself\u001b[39;49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43m_encode\u001b[49m\u001b[43m(\u001b[49m\u001b[43mdocuments\u001b[49m\u001b[43m)\u001b[49m\n",
+      "File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/milvus_model/dense/onnx.py:32\u001b[0m, in \u001b[0;36mOnnxEmbeddingFunction._encode\u001b[0;34m(self, texts)\u001b[0m\n\u001b[1;32m     31\u001b[0m \u001b[38;5;28;01mdef\u001b[39;00m \u001b[38;5;21m_encode\u001b[39m(\u001b[38;5;28mself\u001b[39m, texts: List[\u001b[38;5;28mstr\u001b[39m]) \u001b[38;5;241m-\u001b[39m\u001b[38;5;241m>\u001b[39m List[np\u001b[38;5;241m.\u001b[39marray]:\n\u001b[0;32m---> 32\u001b[0m     \u001b[38;5;28;01mreturn\u001b[39;00m [\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39m_to_embedding(text) \u001b[38;5;28;01mfor\u001b[39;00m text \u001b[38;5;129;01min\u001b[39;00m texts]\n",
+      "File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/milvus_model/dense/onnx.py:32\u001b[0m, in \u001b[0;36m<listcomp>\u001b[0;34m(.0)\u001b[0m\n\u001b[1;32m     31\u001b[0m \u001b[38;5;28;01mdef\u001b[39;00m \u001b[38;5;21m_encode\u001b[39m(\u001b[38;5;28mself\u001b[39m, texts: List[\u001b[38;5;28mstr\u001b[39m]) \u001b[38;5;241m-\u001b[39m\u001b[38;5;241m>\u001b[39m List[np\u001b[38;5;241m.\u001b[39marray]:\n\u001b[0;32m---> 32\u001b[0m     \u001b[38;5;28;01mreturn\u001b[39;00m [\u001b[38;5;28;43mself\u001b[39;49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43m_to_embedding\u001b[49m\u001b[43m(\u001b[49m\u001b[43mtext\u001b[49m\u001b[43m)\u001b[49m \u001b[38;5;28;01mfor\u001b[39;00m text \u001b[38;5;129;01min\u001b[39;00m texts]\n",
+      "File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/milvus_model/dense/onnx.py:45\u001b[0m, in \u001b[0;36mOnnxEmbeddingFunction._to_embedding\u001b[0;34m(self, data, **_)\u001b[0m\n\u001b[1;32m     43\u001b[0m ort_outputs \u001b[38;5;241m=\u001b[39m \u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mort_session\u001b[38;5;241m.\u001b[39mrun(\u001b[38;5;28;01mNone\u001b[39;00m, ort_inputs)\n\u001b[1;32m     44\u001b[0m ort_feat \u001b[38;5;241m=\u001b[39m ort_outputs[\u001b[38;5;241m0\u001b[39m]\n\u001b[0;32m---> 45\u001b[0m emb \u001b[38;5;241m=\u001b[39m \u001b[38;5;28;43mself\u001b[39;49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43m_post_proc\u001b[49m\u001b[43m(\u001b[49m\u001b[43mort_feat\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mort_inputs\u001b[49m\u001b[43m[\u001b[49m\u001b[38;5;124;43m\"\u001b[39;49m\u001b[38;5;124;43mattention_mask\u001b[39;49m\u001b[38;5;124;43m\"\u001b[39;49m\u001b[43m]\u001b[49m\u001b[43m)\u001b[49m\n\u001b[1;32m     46\u001b[0m emb \u001b[38;5;241m=\u001b[39m  emb\u001b[38;5;241m.\u001b[39mflatten()\n\u001b[1;32m     47\u001b[0m \u001b[38;5;28;01mreturn\u001b[39;00m emb \u001b[38;5;241m/\u001b[39m np\u001b[38;5;241m.\u001b[39mlinalg\u001b[38;5;241m.\u001b[39mnorm(emb)\n",
+      "File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/milvus_model/dense/onnx.py:55\u001b[0m, in \u001b[0;36mOnnxEmbeddingFunction._post_proc\u001b[0;34m(self, token_embeddings, attention_mask)\u001b[0m\n\u001b[1;32m     49\u001b[0m \u001b[38;5;28;01mdef\u001b[39;00m \u001b[38;5;21m_post_proc\u001b[39m(\u001b[38;5;28mself\u001b[39m, token_embeddings, attention_mask):\n\u001b[1;32m     50\u001b[0m     input_mask_expanded \u001b[38;5;241m=\u001b[39m (\n\u001b[1;32m     51\u001b[0m         np\u001b[38;5;241m.\u001b[39mexpand_dims(attention_mask, \u001b[38;5;241m-\u001b[39m\u001b[38;5;241m1\u001b[39m)\n\u001b[1;32m     52\u001b[0m         \u001b[38;5;241m.\u001b[39mrepeat(token_embeddings\u001b[38;5;241m.\u001b[39mshape[\u001b[38;5;241m-\u001b[39m\u001b[38;5;241m1\u001b[39m], \u001b[38;5;241m-\u001b[39m\u001b[38;5;241m1\u001b[39m)\n\u001b[1;32m     53\u001b[0m         \u001b[38;5;241m.\u001b[39mastype(\u001b[38;5;28mfloat\u001b[39m)\n\u001b[1;32m     54\u001b[0m     )\n\u001b[0;32m---> 55\u001b[0m     sentence_embs \u001b[38;5;241m=\u001b[39m np\u001b[38;5;241m.\u001b[39msum(\u001b[43mtoken_embeddings\u001b[49m\u001b[43m \u001b[49m\u001b[38;5;241;43m*\u001b[39;49m\u001b[43m \u001b[49m\u001b[43minput_mask_expanded\u001b[49m, \u001b[38;5;241m1\u001b[39m) \u001b[38;5;241m/\u001b[39m np\u001b[38;5;241m.\u001b[39mmaximum(\n\u001b[1;32m     56\u001b[0m         input_mask_expanded\u001b[38;5;241m.\u001b[39msum(\u001b[38;5;241m1\u001b[39m), \u001b[38;5;241m1e-9\u001b[39m\n\u001b[1;32m     57\u001b[0m     )\n\u001b[1;32m     58\u001b[0m     \u001b[38;5;28;01mreturn\u001b[39;00m sentence_embs\n",
+      "File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/numpy/core/_internal.py:855\u001b[0m, in \u001b[0;36marray_ufunc_errmsg_formatter\u001b[0;34m(dummy, ufunc, method, *inputs, **kwargs)\u001b[0m\n\u001b[1;32m    853\u001b[0m \u001b[38;5;28;01mdef\u001b[39;00m \u001b[38;5;21marray_ufunc_errmsg_formatter\u001b[39m(dummy, ufunc, method, \u001b[38;5;241m*\u001b[39minputs, \u001b[38;5;241m*\u001b[39m\u001b[38;5;241m*\u001b[39mkwargs):\n\u001b[1;32m    854\u001b[0m \u001b[38;5;250m    \u001b[39m\u001b[38;5;124;03m\"\"\" Format the error message for when __array_ufunc__ gives up. \"\"\"\u001b[39;00m\n\u001b[0;32m--> 855\u001b[0m     args_string \u001b[38;5;241m=\u001b[39m \u001b[38;5;124m'\u001b[39m\u001b[38;5;124m, \u001b[39m\u001b[38;5;124m'\u001b[39m\u001b[38;5;241m.\u001b[39mjoin([\u001b[38;5;124m'\u001b[39m\u001b[38;5;132;01m{!r}\u001b[39;00m\u001b[38;5;124m'\u001b[39m\u001b[38;5;241m.\u001b[39mformat(arg) \u001b[38;5;28;01mfor\u001b[39;00m arg \u001b[38;5;129;01min\u001b[39;00m inputs] \u001b[38;5;241m+\u001b[39m\n\u001b[1;32m    856\u001b[0m                             [\u001b[38;5;124m'\u001b[39m\u001b[38;5;132;01m{}\u001b[39;00m\u001b[38;5;124m=\u001b[39m\u001b[38;5;132;01m{!r}\u001b[39;00m\u001b[38;5;124m'\u001b[39m\u001b[38;5;241m.\u001b[39mformat(k, v)\n\u001b[1;32m    857\u001b[0m                              \u001b[38;5;28;01mfor\u001b[39;00m k, v \u001b[38;5;129;01min\u001b[39;00m kwargs\u001b[38;5;241m.\u001b[39mitems()])\n\u001b[1;32m    858\u001b[0m     args \u001b[38;5;241m=\u001b[39m inputs \u001b[38;5;241m+\u001b[39m kwargs\u001b[38;5;241m.\u001b[39mget(\u001b[38;5;124m'\u001b[39m\u001b[38;5;124mout\u001b[39m\u001b[38;5;124m'\u001b[39m, ())\n\u001b[1;32m    859\u001b[0m     types_string \u001b[38;5;241m=\u001b[39m \u001b[38;5;124m'\u001b[39m\u001b[38;5;124m, \u001b[39m\u001b[38;5;124m'\u001b[39m\u001b[38;5;241m.\u001b[39mjoin(\u001b[38;5;28mrepr\u001b[39m(\u001b[38;5;28mtype\u001b[39m(arg)\u001b[38;5;241m.\u001b[39m\u001b[38;5;18m__name__\u001b[39m) \u001b[38;5;28;01mfor\u001b[39;00m arg \u001b[38;5;129;01min\u001b[39;00m args)\n",
+      "File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/numpy/core/_internal.py:855\u001b[0m, in \u001b[0;36m<listcomp>\u001b[0;34m(.0)\u001b[0m\n\u001b[1;32m    853\u001b[0m \u001b[38;5;28;01mdef\u001b[39;00m \u001b[38;5;21marray_ufunc_errmsg_formatter\u001b[39m(dummy, ufunc, method, \u001b[38;5;241m*\u001b[39minputs, \u001b[38;5;241m*\u001b[39m\u001b[38;5;241m*\u001b[39mkwargs):\n\u001b[1;32m    854\u001b[0m \u001b[38;5;250m    \u001b[39m\u001b[38;5;124;03m\"\"\" Format the error message for when __array_ufunc__ gives up. \"\"\"\u001b[39;00m\n\u001b[0;32m--> 855\u001b[0m     args_string \u001b[38;5;241m=\u001b[39m \u001b[38;5;124m'\u001b[39m\u001b[38;5;124m, \u001b[39m\u001b[38;5;124m'\u001b[39m\u001b[38;5;241m.\u001b[39mjoin([\u001b[38;5;124;43m'\u001b[39;49m\u001b[38;5;132;43;01m{!r}\u001b[39;49;00m\u001b[38;5;124;43m'\u001b[39;49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mformat\u001b[49m\u001b[43m(\u001b[49m\u001b[43marg\u001b[49m\u001b[43m)\u001b[49m \u001b[38;5;28;01mfor\u001b[39;00m arg \u001b[38;5;129;01min\u001b[39;00m inputs] \u001b[38;5;241m+\u001b[39m\n\u001b[1;32m    856\u001b[0m                             [\u001b[38;5;124m'\u001b[39m\u001b[38;5;132;01m{}\u001b[39;00m\u001b[38;5;124m=\u001b[39m\u001b[38;5;132;01m{!r}\u001b[39;00m\u001b[38;5;124m'\u001b[39m\u001b[38;5;241m.\u001b[39mformat(k, v)\n\u001b[1;32m    857\u001b[0m                              \u001b[38;5;28;01mfor\u001b[39;00m k, v \u001b[38;5;129;01min\u001b[39;00m kwargs\u001b[38;5;241m.\u001b[39mitems()])\n\u001b[1;32m    858\u001b[0m     args \u001b[38;5;241m=\u001b[39m inputs \u001b[38;5;241m+\u001b[39m kwargs\u001b[38;5;241m.\u001b[39mget(\u001b[38;5;124m'\u001b[39m\u001b[38;5;124mout\u001b[39m\u001b[38;5;124m'\u001b[39m, ())\n\u001b[1;32m    859\u001b[0m     types_string \u001b[38;5;241m=\u001b[39m \u001b[38;5;124m'\u001b[39m\u001b[38;5;124m, \u001b[39m\u001b[38;5;124m'\u001b[39m\u001b[38;5;241m.\u001b[39mjoin(\u001b[38;5;28mrepr\u001b[39m(\u001b[38;5;28mtype\u001b[39m(arg)\u001b[38;5;241m.\u001b[39m\u001b[38;5;18m__name__\u001b[39m) \u001b[38;5;28;01mfor\u001b[39;00m arg \u001b[38;5;129;01min\u001b[39;00m args)\n",
+      "File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/numpy/core/arrayprint.py:1499\u001b[0m, in \u001b[0;36m_array_repr_implementation\u001b[0;34m(arr, max_line_width, precision, suppress_small, array2string)\u001b[0m\n\u001b[1;32m   1496\u001b[0m \u001b[38;5;28;01melse\u001b[39;00m:\n\u001b[1;32m   1497\u001b[0m     class_name \u001b[38;5;241m=\u001b[39m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124marray\u001b[39m\u001b[38;5;124m\"\u001b[39m\n\u001b[0;32m-> 1499\u001b[0m skipdtype \u001b[38;5;241m=\u001b[39m \u001b[43mdtype_is_implied\u001b[49m\u001b[43m(\u001b[49m\u001b[43marr\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mdtype\u001b[49m\u001b[43m)\u001b[49m \u001b[38;5;129;01mand\u001b[39;00m arr\u001b[38;5;241m.\u001b[39msize \u001b[38;5;241m>\u001b[39m \u001b[38;5;241m0\u001b[39m\n\u001b[1;32m   1501\u001b[0m prefix \u001b[38;5;241m=\u001b[39m class_name \u001b[38;5;241m+\u001b[39m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124m(\u001b[39m\u001b[38;5;124m\"\u001b[39m\n\u001b[1;32m   1502\u001b[0m suffix \u001b[38;5;241m=\u001b[39m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124m)\u001b[39m\u001b[38;5;124m\"\u001b[39m \u001b[38;5;28;01mif\u001b[39;00m skipdtype \u001b[38;5;28;01melse\u001b[39;00m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124m,\u001b[39m\u001b[38;5;124m\"\u001b[39m\n",
+      "File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/numpy/core/arrayprint.py:1440\u001b[0m, in \u001b[0;36mdtype_is_implied\u001b[0;34m(dtype)\u001b[0m\n\u001b[1;32m   1415\u001b[0m \u001b[38;5;28;01mdef\u001b[39;00m \u001b[38;5;21mdtype_is_implied\u001b[39m(dtype):\n\u001b[1;32m   1416\u001b[0m \u001b[38;5;250m    \u001b[39m\u001b[38;5;124;03m\"\"\"\u001b[39;00m\n\u001b[1;32m   1417\u001b[0m \u001b[38;5;124;03m    Determine if the given dtype is implied by the representation of its values.\u001b[39;00m\n\u001b[1;32m   1418\u001b[0m \n\u001b[0;32m   (...)\u001b[0m\n\u001b[1;32m   1438\u001b[0m \u001b[38;5;124;03m    array([1, 2, 3], dtype=int8)\u001b[39;00m\n\u001b[1;32m   1439\u001b[0m \u001b[38;5;124;03m    \"\"\"\u001b[39;00m\n\u001b[0;32m-> 1440\u001b[0m     dtype \u001b[38;5;241m=\u001b[39m \u001b[43mnp\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mdtype\u001b[49m\u001b[43m(\u001b[49m\u001b[43mdtype\u001b[49m\u001b[43m)\u001b[49m\n\u001b[1;32m   1441\u001b[0m     \u001b[38;5;28;01mif\u001b[39;00m _format_options[\u001b[38;5;124m'\u001b[39m\u001b[38;5;124mlegacy\u001b[39m\u001b[38;5;124m'\u001b[39m] \u001b[38;5;241m<\u001b[39m\u001b[38;5;241m=\u001b[39m \u001b[38;5;241m113\u001b[39m \u001b[38;5;129;01mand\u001b[39;00m dtype\u001b[38;5;241m.\u001b[39mtype \u001b[38;5;241m==\u001b[39m bool_:\n\u001b[1;32m   1442\u001b[0m         \u001b[38;5;28;01mreturn\u001b[39;00m \u001b[38;5;28;01mFalse\u001b[39;00m\n",
+      "\u001b[0;31mTypeError\u001b[0m: "
+     ]
+    }
+   ],
+   "source": [
+    "from pymilvus import model\n",
+    "\n",
+    "\n",
+    "embedding_fn = model.DefaultEmbeddingFunction()\n",
+    "\n",
+    "docs = [\n",
+    "    \"Artificial intelligence was founded as an academic discipline in 1956.\",\n",
+    "    \"Alan Turing was the first person to conduct substantial research in AI.\",\n",
+    "    \"Born in Maida Vale, London, Turing was raised in southern England.\",\n",
+    "]\n",
+    "\n",
+    "vectors = embedding_fn.encode_documents(docs)\n",
+    "print(\"Dim:\", embedding_fn.dim, vectors[0].shape)  # Dim: 768 (768,)\n",
+    "\n",
+    "data = [\n",
+    "    {\"id\": i, \"vector\": vectors[i], \"text\": docs[i], \"subject\": \"history\"}\n",
+    "    for i in range(len(vectors))\n",
+    "]\n",
+    "\n",
+    "print(\"Data has\", len(data), \"entities, each with fields: \", data[0].keys())\n",
+    "print(\"Vector dim:\", len(data[0][\"vector\"]))"


Fix the TypeError in encode_documents method.

The code results in a TypeError when calling the encode_documents method. Verify the method usage and ensure the correct parameters are being passed.

- vectors = embedding_fn.encode_documents(docs) + try: + vectors = embedding_fn.encode_documents(docs) + except TypeError as e: + print(f"Error encoding documents: {e}")

Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change

"cell_type": "code",

"execution_count": 8,

"metadata": {},

"outputs": [

{

"ename": "TypeError",

"evalue": "",

"output_type": "error",

"traceback": [

"\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",

"\u001b[0;31mTypeError\u001b[0m Traceback (most recent call last)",

"Cell \u001b[0;32mIn[8], line 12\u001b[0m\n\u001b[1;32m 4\u001b[0m embedding_fn \u001b[38;5;241m=\u001b[39m model\u001b[38;5;241m.\u001b[39mDefaultEmbeddingFunction()\n\u001b[1;32m 6\u001b[0m docs \u001b[38;5;241m=\u001b[39m [\n\u001b[1;32m 7\u001b[0m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mArtificial intelligence was founded as an academic discipline in 1956.\u001b[39m\u001b[38;5;124m\"\u001b[39m,\n\u001b[1;32m 8\u001b[0m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mAlan Turing was the first person to conduct substantial research in AI.\u001b[39m\u001b[38;5;124m\"\u001b[39m,\n\u001b[1;32m 9\u001b[0m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mBorn in Maida Vale, London, Turing was raised in southern England.\u001b[39m\u001b[38;5;124m\"\u001b[39m,\n\u001b[1;32m 10\u001b[0m ]\n\u001b[0;32m---> 12\u001b[0m vectors \u001b[38;5;241m=\u001b[39m \u001b[43membedding_fn\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mencode_documents\u001b[49m\u001b[43m(\u001b[49m\u001b[43mdocs\u001b[49m\u001b[43m)\u001b[49m\n\u001b[1;32m 13\u001b[0m \u001b[38;5;28mprint\u001b[39m(\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mDim:\u001b[39m\u001b[38;5;124m\"\u001b[39m, embedding_fn\u001b[38;5;241m.\u001b[39mdim, vectors[\u001b[38;5;241m0\u001b[39m]\u001b[38;5;241m.\u001b[39mshape) \u001b[38;5;66;03m# Dim: 768 (768,)\u001b[39;00m\n\u001b[1;32m 15\u001b[0m data \u001b[38;5;241m=\u001b[39m [\n\u001b[1;32m 16\u001b[0m {\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mid\u001b[39m\u001b[38;5;124m\"\u001b[39m: i, \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mvector\u001b[39m\u001b[38;5;124m\"\u001b[39m: vectors[i], \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mtext\u001b[39m\u001b[38;5;124m\"\u001b[39m: docs[i], \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124msubject\u001b[39m\u001b[38;5;124m\"\u001b[39m: \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mhistory\u001b[39m\u001b[38;5;124m\"\u001b[39m}\n\u001b[1;32m 17\u001b[0m \u001b[38;5;28;01mfor\u001b[39;00m i \u001b[38;5;129;01min\u001b[39;00m \u001b[38;5;28mrange\u001b[39m(\u001b[38;5;28mlen\u001b[39m(vectors))\n\u001b[1;32m 18\u001b[0m ]\n",

"File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/milvus_model/dense/onnx.py:29\u001b[0m, in \u001b[0;36mOnnxEmbeddingFunction.encode_documents\u001b[0;34m(self, documents)\u001b[0m\n\u001b[1;32m 28\u001b[0m \u001b[38;5;28;01mdef\u001b[39;00m \u001b[38;5;21mencode_documents\u001b[39m(\u001b[38;5;28mself\u001b[39m, documents: List[\u001b[38;5;28mstr\u001b[39m]) \u001b[38;5;241m-\u001b[39m\u001b[38;5;241m>\u001b[39m List[np\u001b[38;5;241m.\u001b[39marray]:\n\u001b[0;32m---> 29\u001b[0m \u001b[38;5;28;01mreturn\u001b[39;00m \u001b[38;5;28;43mself\u001b[39;49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43m_encode\u001b[49m\u001b[43m(\u001b[49m\u001b[43mdocuments\u001b[49m\u001b[43m)\u001b[49m\n",

"File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/milvus_model/dense/onnx.py:32\u001b[0m, in \u001b[0;36mOnnxEmbeddingFunction._encode\u001b[0;34m(self, texts)\u001b[0m\n\u001b[1;32m 31\u001b[0m \u001b[38;5;28;01mdef\u001b[39;00m \u001b[38;5;21m_encode\u001b[39m(\u001b[38;5;28mself\u001b[39m, texts: List[\u001b[38;5;28mstr\u001b[39m]) \u001b[38;5;241m-\u001b[39m\u001b[38;5;241m>\u001b[39m List[np\u001b[38;5;241m.\u001b[39marray]:\n\u001b[0;32m---> 32\u001b[0m \u001b[38;5;28;01mreturn\u001b[39;00m [\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39m_to_embedding(text) \u001b[38;5;28;01mfor\u001b[39;00m text \u001b[38;5;129;01min\u001b[39;00m texts]\n",

"File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/milvus_model/dense/onnx.py:32\u001b[0m, in \u001b[0;36m<listcomp>\u001b[0;34m(.0)\u001b[0m\n\u001b[1;32m 31\u001b[0m \u001b[38;5;28;01mdef\u001b[39;00m \u001b[38;5;21m_encode\u001b[39m(\u001b[38;5;28mself\u001b[39m, texts: List[\u001b[38;5;28mstr\u001b[39m]) \u001b[38;5;241m-\u001b[39m\u001b[38;5;241m>\u001b[39m List[np\u001b[38;5;241m.\u001b[39marray]:\n\u001b[0;32m---> 32\u001b[0m \u001b[38;5;28;01mreturn\u001b[39;00m [\u001b[38;5;28;43mself\u001b[39;49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43m_to_embedding\u001b[49m\u001b[43m(\u001b[49m\u001b[43mtext\u001b[49m\u001b[43m)\u001b[49m \u001b[38;5;28;01mfor\u001b[39;00m text \u001b[38;5;129;01min\u001b[39;00m texts]\n",

"File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/milvus_model/dense/onnx.py:45\u001b[0m, in \u001b[0;36mOnnxEmbeddingFunction._to_embedding\u001b[0;34m(self, data, **_)\u001b[0m\n\u001b[1;32m 43\u001b[0m ort_outputs \u001b[38;5;241m=\u001b[39m \u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mort_session\u001b[38;5;241m.\u001b[39mrun(\u001b[38;5;28;01mNone\u001b[39;00m, ort_inputs)\n\u001b[1;32m 44\u001b[0m ort_feat \u001b[38;5;241m=\u001b[39m ort_outputs[\u001b[38;5;241m0\u001b[39m]\n\u001b[0;32m---> 45\u001b[0m emb \u001b[38;5;241m=\u001b[39m \u001b[38;5;28;43mself\u001b[39;49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43m_post_proc\u001b[49m\u001b[43m(\u001b[49m\u001b[43mort_feat\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mort_inputs\u001b[49m\u001b[43m[\u001b[49m\u001b[38;5;124;43m\"\u001b[39;49m\u001b[38;5;124;43mattention_mask\u001b[39;49m\u001b[38;5;124;43m\"\u001b[39;49m\u001b[43m]\u001b[49m\u001b[43m)\u001b[49m\n\u001b[1;32m 46\u001b[0m emb \u001b[38;5;241m=\u001b[39m emb\u001b[38;5;241m.\u001b[39mflatten()\n\u001b[1;32m 47\u001b[0m \u001b[38;5;28;01mreturn\u001b[39;00m emb \u001b[38;5;241m/\u001b[39m np\u001b[38;5;241m.\u001b[39mlinalg\u001b[38;5;241m.\u001b[39mnorm(emb)\n",

"File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/milvus_model/dense/onnx.py:55\u001b[0m, in \u001b[0;36mOnnxEmbeddingFunction._post_proc\u001b[0;34m(self, token_embeddings, attention_mask)\u001b[0m\n\u001b[1;32m 49\u001b[0m \u001b[38;5;28;01mdef\u001b[39;00m \u001b[38;5;21m_post_proc\u001b[39m(\u001b[38;5;28mself\u001b[39m, token_embeddings, attention_mask):\n\u001b[1;32m 50\u001b[0m input_mask_expanded \u001b[38;5;241m=\u001b[39m (\n\u001b[1;32m 51\u001b[0m np\u001b[38;5;241m.\u001b[39mexpand_dims(attention_mask, \u001b[38;5;241m-\u001b[39m\u001b[38;5;241m1\u001b[39m)\n\u001b[1;32m 52\u001b[0m \u001b[38;5;241m.\u001b[39mrepeat(token_embeddings\u001b[38;5;241m.\u001b[39mshape[\u001b[38;5;241m-\u001b[39m\u001b[38;5;241m1\u001b[39m], \u001b[38;5;241m-\u001b[39m\u001b[38;5;241m1\u001b[39m)\n\u001b[1;32m 53\u001b[0m \u001b[38;5;241m.\u001b[39mastype(\u001b[38;5;28mfloat\u001b[39m)\n\u001b[1;32m 54\u001b[0m )\n\u001b[0;32m---> 55\u001b[0m sentence_embs \u001b[38;5;241m=\u001b[39m np\u001b[38;5;241m.\u001b[39msum(\u001b[43mtoken_embeddings\u001b[49m\u001b[43m \u001b[49m\u001b[38;5;241;43m*\u001b[39;49m\u001b[43m \u001b[49m\u001b[43minput_mask_expanded\u001b[49m, \u001b[38;5;241m1\u001b[39m) \u001b[38;5;241m/\u001b[39m np\u001b[38;5;241m.\u001b[39mmaximum(\n\u001b[1;32m 56\u001b[0m input_mask_expanded\u001b[38;5;241m.\u001b[39msum(\u001b[38;5;241m1\u001b[39m), \u001b[38;5;241m1e-9\u001b[39m\n\u001b[1;32m 57\u001b[0m )\n\u001b[1;32m 58\u001b[0m \u001b[38;5;28;01mreturn\u001b[39;00m sentence_embs\n",

"File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/numpy/core/_internal.py:855\u001b[0m, in \u001b[0;36marray_ufunc_errmsg_formatter\u001b[0;34m(dummy, ufunc, method, *inputs, **kwargs)\u001b[0m\n\u001b[1;32m 853\u001b[0m \u001b[38;5;28;01mdef\u001b[39;00m \u001b[38;5;21marray_ufunc_errmsg_formatter\u001b[39m(dummy, ufunc, method, \u001b[38;5;241m*\u001b[39minputs, \u001b[38;5;241m*\u001b[39m\u001b[38;5;241m*\u001b[39mkwargs):\n\u001b[1;32m 854\u001b[0m \u001b[38;5;250m \u001b[39m\u001b[38;5;124;03m\"\"\" Format the error message for when __array_ufunc__ gives up. \"\"\"\u001b[39;00m\n\u001b[0;32m--> 855\u001b[0m args_string \u001b[38;5;241m=\u001b[39m \u001b[38;5;124m'\u001b[39m\u001b[38;5;124m, \u001b[39m\u001b[38;5;124m'\u001b[39m\u001b[38;5;241m.\u001b[39mjoin([\u001b[38;5;124m'\u001b[39m\u001b[38;5;132;01m{!r}\u001b[39;00m\u001b[38;5;124m'\u001b[39m\u001b[38;5;241m.\u001b[39mformat(arg) \u001b[38;5;28;01mfor\u001b[39;00m arg \u001b[38;5;129;01min\u001b[39;00m inputs] \u001b[38;5;241m+\u001b[39m\n\u001b[1;32m 856\u001b[0m [\u001b[38;5;124m'\u001b[39m\u001b[38;5;132;01m{}\u001b[39;00m\u001b[38;5;124m=\u001b[39m\u001b[38;5;132;01m{!r}\u001b[39;00m\u001b[38;5;124m'\u001b[39m\u001b[38;5;241m.\u001b[39mformat(k, v)\n\u001b[1;32m 857\u001b[0m \u001b[38;5;28;01mfor\u001b[39;00m k, v \u001b[38;5;129;01min\u001b[39;00m kwargs\u001b[38;5;241m.\u001b[39mitems()])\n\u001b[1;32m 858\u001b[0m args \u001b[38;5;241m=\u001b[39m inputs \u001b[38;5;241m+\u001b[39m kwargs\u001b[38;5;241m.\u001b[39mget(\u001b[38;5;124m'\u001b[39m\u001b[38;5;124mout\u001b[39m\u001b[38;5;124m'\u001b[39m, ())\n\u001b[1;32m 859\u001b[0m types_string \u001b[38;5;241m=\u001b[39m \u001b[38;5;124m'\u001b[39m\u001b[38;5;124m, \u001b[39m\u001b[38;5;124m'\u001b[39m\u001b[38;5;241m.\u001b[39mjoin(\u001b[38;5;28mrepr\u001b[39m(\u001b[38;5;28mtype\u001b[39m(arg)\u001b[38;5;241m.\u001b[39m\u001b[38;5;18m__name__\u001b[39m) \u001b[38;5;28;01mfor\u001b[39;00m arg \u001b[38;5;129;01min\u001b[39;00m args)\n",

"File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/numpy/core/_internal.py:855\u001b[0m, in \u001b[0;36m<listcomp>\u001b[0;34m(.0)\u001b[0m\n\u001b[1;32m 853\u001b[0m \u001b[38;5;28;01mdef\u001b[39;00m \u001b[38;5;21marray_ufunc_errmsg_formatter\u001b[39m(dummy, ufunc, method, \u001b[38;5;241m*\u001b[39minputs, \u001b[38;5;241m*\u001b[39m\u001b[38;5;241m*\u001b[39mkwargs):\n\u001b[1;32m 854\u001b[0m \u001b[38;5;250m \u001b[39m\u001b[38;5;124;03m\"\"\" Format the error message for when __array_ufunc__ gives up. \"\"\"\u001b[39;00m\n\u001b[0;32m--> 855\u001b[0m args_string \u001b[38;5;241m=\u001b[39m \u001b[38;5;124m'\u001b[39m\u001b[38;5;124m, \u001b[39m\u001b[38;5;124m'\u001b[39m\u001b[38;5;241m.\u001b[39mjoin([\u001b[38;5;124;43m'\u001b[39;49m\u001b[38;5;132;43;01m{!r}\u001b[39;49;00m\u001b[38;5;124;43m'\u001b[39;49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mformat\u001b[49m\u001b[43m(\u001b[49m\u001b[43marg\u001b[49m\u001b[43m)\u001b[49m \u001b[38;5;28;01mfor\u001b[39;00m arg \u001b[38;5;129;01min\u001b[39;00m inputs] \u001b[38;5;241m+\u001b[39m\n\u001b[1;32m 856\u001b[0m [\u001b[38;5;124m'\u001b[39m\u001b[38;5;132;01m{}\u001b[39;00m\u001b[38;5;124m=\u001b[39m\u001b[38;5;132;01m{!r}\u001b[39;00m\u001b[38;5;124m'\u001b[39m\u001b[38;5;241m.\u001b[39mformat(k, v)\n\u001b[1;32m 857\u001b[0m \u001b[38;5;28;01mfor\u001b[39;00m k, v \u001b[38;5;129;01min\u001b[39;00m kwargs\u001b[38;5;241m.\u001b[39mitems()])\n\u001b[1;32m 858\u001b[0m args \u001b[38;5;241m=\u001b[39m inputs \u001b[38;5;241m+\u001b[39m kwargs\u001b[38;5;241m.\u001b[39mget(\u001b[38;5;124m'\u001b[39m\u001b[38;5;124mout\u001b[39m\u001b[38;5;124m'\u001b[39m, ())\n\u001b[1;32m 859\u001b[0m types_string \u001b[38;5;241m=\u001b[39m \u001b[38;5;124m'\u001b[39m\u001b[38;5;124m, \u001b[39m\u001b[38;5;124m'\u001b[39m\u001b[38;5;241m.\u001b[39mjoin(\u001b[38;5;28mrepr\u001b[39m(\u001b[38;5;28mtype\u001b[39m(arg)\u001b[38;5;241m.\u001b[39m\u001b[38;5;18m__name__\u001b[39m) \u001b[38;5;28;01mfor\u001b[39;00m arg \u001b[38;5;129;01min\u001b[39;00m args)\n",

"File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/numpy/core/arrayprint.py:1499\u001b[0m, in \u001b[0;36m_array_repr_implementation\u001b[0;34m(arr, max_line_width, precision, suppress_small, array2string)\u001b[0m\n\u001b[1;32m 1496\u001b[0m \u001b[38;5;28;01melse\u001b[39;00m:\n\u001b[1;32m 1497\u001b[0m class_name \u001b[38;5;241m=\u001b[39m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124marray\u001b[39m\u001b[38;5;124m\"\u001b[39m\n\u001b[0;32m-> 1499\u001b[0m skipdtype \u001b[38;5;241m=\u001b[39m \u001b[43mdtype_is_implied\u001b[49m\u001b[43m(\u001b[49m\u001b[43marr\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mdtype\u001b[49m\u001b[43m)\u001b[49m \u001b[38;5;129;01mand\u001b[39;00m arr\u001b[38;5;241m.\u001b[39msize \u001b[38;5;241m>\u001b[39m \u001b[38;5;241m0\u001b[39m\n\u001b[1;32m 1501\u001b[0m prefix \u001b[38;5;241m=\u001b[39m class_name \u001b[38;5;241m+\u001b[39m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124m(\u001b[39m\u001b[38;5;124m\"\u001b[39m\n\u001b[1;32m 1502\u001b[0m suffix \u001b[38;5;241m=\u001b[39m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124m)\u001b[39m\u001b[38;5;124m\"\u001b[39m \u001b[38;5;28;01mif\u001b[39;00m skipdtype \u001b[38;5;28;01melse\u001b[39;00m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124m,\u001b[39m\u001b[38;5;124m\"\u001b[39m\n",

"File \u001b[0;32m~/pr-agent/lib/python3.10/site-packages/numpy/core/arrayprint.py:1440\u001b[0m, in \u001b[0;36mdtype_is_implied\u001b[0;34m(dtype)\u001b[0m\n\u001b[1;32m 1415\u001b[0m \u001b[38;5;28;01mdef\u001b[39;00m \u001b[38;5;21mdtype_is_implied\u001b[39m(dtype):\n\u001b[1;32m 1416\u001b[0m \u001b[38;5;250m \u001b[39m\u001b[38;5;124;03m\"\"\"\u001b[39;00m\n\u001b[1;32m 1417\u001b[0m \u001b[38;5;124;03m Determine if the given dtype is implied by the representation of its values.\u001b[39;00m\n\u001b[1;32m 1418\u001b[0m \n\u001b[0;32m (...)\u001b[0m\n\u001b[1;32m 1438\u001b[0m \u001b[38;5;124;03m array([1, 2, 3], dtype=int8)\u001b[39;00m\n\u001b[1;32m 1439\u001b[0m \u001b[38;5;124;03m \"\"\"\u001b[39;00m\n\u001b[0;32m-> 1440\u001b[0m dtype \u001b[38;5;241m=\u001b[39m \u001b[43mnp\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mdtype\u001b[49m\u001b[43m(\u001b[49m\u001b[43mdtype\u001b[49m\u001b[43m)\u001b[49m\n\u001b[1;32m 1441\u001b[0m \u001b[38;5;28;01mif\u001b[39;00m _format_options[\u001b[38;5;124m'\u001b[39m\u001b[38;5;124mlegacy\u001b[39m\u001b[38;5;124m'\u001b[39m] \u001b[38;5;241m<\u001b[39m\u001b[38;5;241m=\u001b[39m \u001b[38;5;241m113\u001b[39m \u001b[38;5;129;01mand\u001b[39;00m dtype\u001b[38;5;241m.\u001b[39mtype \u001b[38;5;241m==\u001b[39m bool_:\n\u001b[1;32m 1442\u001b[0m \u001b[38;5;28;01mreturn\u001b[39;00m \u001b[38;5;28;01mFalse\u001b[39;00m\n",

"\u001b[0;31mTypeError\u001b[0m: "

]

}

],

"source": [

"from pymilvus import model\n",

"\n",

"\n",

"embedding_fn = model.DefaultEmbeddingFunction()\n",

"\n",

"docs = [\n",

" \"Artificial intelligence was founded as an academic discipline in 1956.\",\n",

" \"Alan Turing was the first person to conduct substantial research in AI.\",\n",

" \"Born in Maida Vale, London, Turing was raised in southern England.\",\n",

"]\n",

"\n",

"vectors = embedding_fn.encode_documents(docs)\n",

"print(\"Dim:\", embedding_fn.dim, vectors[0].shape) # Dim: 768 (768,)\n",

"\n",

"data = [\n",

" {\"id\": i, \"vector\": vectors[i], \"text\": docs[i], \"subject\": \"history\"}\n",

" for i in range(len(vectors))\n",

"]\n",

"\n",

"print(\"Data has\", len(data), \"entities, each with fields: \", data[0].keys())\n",

"print(\"Vector dim:\", len(data[0][\"vector\"]))"

milvus

880961d

gyliu513 force-pushed the milvus branch from 78eb362 to 880961d Compare July 25, 2024 20:02

github-actions bot added enhancement New feature or request tests labels Jul 25, 2024

github-actions bot added the Review effort [1-5]: 4 label Jul 25, 2024

gyliu513 merged commit 88031a1 into main Jul 25, 2024
1 of 2 checks passed

gyliu513 deleted the milvus branch July 25, 2024 20:04

coderabbitai bot reviewed Jul 25, 2024

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

milvus #184

milvus #184

gyliu513 commented Jul 25, 2024 •

edited by coderabbitai bot

Loading

coderabbitai bot commented Jul 25, 2024 •

edited

Loading

Chat

CodeRabbit Commands (invoked as PR comments)

CodeRabbit Configuration File (`.coderabbit.yaml`)

Documentation and Community

github-actions bot commented Jul 25, 2024

github-actions bot commented Jul 25, 2024 •

edited

Loading

coderabbitai bot left a comment

coderabbitai bot Jul 25, 2024

coderabbitai bot Jul 25, 2024

coderabbitai bot Jul 25, 2024

coderabbitai bot Jul 25, 2024

-   "cell_type": "code",
-   "execution_count": 6,
-   "metadata": {},
-   "outputs": [
-    {
-     "name": "stderr",
-     "output_type": "stream",
-     "text": [
-      "huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...\n",
-      "To disable this warning, you can either:\n",
-      "\t- Avoid using `tokenizers` before the fork if possible\n",
-      "\t- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)\n"
-     ]
-    },
-    {
-     "name": "stdout",
-     "output_type": "stream",
-     "text": [
-      "Collecting jupyter\n",
-      "  Downloading jupyter-1.0.0-py2.py3-none-any.whl (2.7 kB)\n",
-      "Collecting jupyter-console\n",
-      "  Downloading jupyter_console-6.6.3-py3-none-any.whl (24 kB)\n",
-      "Collecting notebook\n",
-      "  Downloading notebook-7.2.1-py3-none-any.whl (5.0 MB)\n",
-      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m5.0/5.0 MB\u001b[0m \u001b[31m12.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m00:01\u001b[0m\n",
-      "\u001b[?25hCollecting nbconvert\n",
-      "  Downloading nbconvert-7.16.4-py3-none-any.whl (257 kB)\n",
-      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m257.4/257.4 kB\u001b[0m \u001b[31m10.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
-      "\u001b[?25hCollecting qtconsole\n",
-      "  Downloading qtconsole-5.5.2-py3-none-any.whl (123 kB)\n",
-      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m123.4/123.4 kB\u001b[0m \u001b[31m6.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
-      "\u001b[?25hRequirement already satisfied: ipykernel in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyter) (6.29.5)\n",
-      "Collecting ipywidgets\n",
-      "  Downloading ipywidgets-8.1.3-py3-none-any.whl (139 kB)\n",
-      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m139.4/139.4 kB\u001b[0m \u001b[31m6.9 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
-      "\u001b[?25hRequirement already satisfied: traitlets>=5.4.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (5.14.3)\n",
-      "Requirement already satisfied: pyzmq>=24 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (26.0.3)\n",
-      "Requirement already satisfied: packaging in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (24.1)\n",
-      "Requirement already satisfied: psutil in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (6.0.0)\n",
-      "Requirement already satisfied: comm>=0.1.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (0.2.2)\n",
-      "Requirement already satisfied: nest-asyncio in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (1.6.0)\n",
-      "Requirement already satisfied: matplotlib-inline>=0.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (0.1.7)\n",
-      "Requirement already satisfied: ipython>=7.23.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (8.26.0)\n",
-      "Requirement already satisfied: tornado>=6.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (6.4.1)\n",
-      "Requirement already satisfied: jupyter-core!=5.0.*,>=4.12 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (5.7.2)\n",
-      "Requirement already satisfied: debugpy>=1.6.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (1.8.2)\n",
-      "Requirement already satisfied: jupyter-client>=6.1.12 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (8.6.2)\n",
-      "Requirement already satisfied: appnope in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipykernel->jupyter) (0.1.4)\n",
-      "Collecting jupyterlab-widgets~=3.0.11\n",
-      "  Downloading jupyterlab_widgets-3.0.11-py3-none-any.whl (214 kB)\n",
-      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m214.4/214.4 kB\u001b[0m \u001b[31m10.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
-      "\u001b[?25hCollecting widgetsnbextension~=4.0.11\n",
-      "  Downloading widgetsnbextension-4.0.11-py3-none-any.whl (2.3 MB)\n",
-      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m2.3/2.3 MB\u001b[0m \u001b[31m15.8 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0ma \u001b[36m0:00:01\u001b[0m\n",
-      "\u001b[?25hRequirement already satisfied: pygments in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyter-console->jupyter) (2.18.0)\n",
-      "Requirement already satisfied: prompt-toolkit>=3.0.30 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyter-console->jupyter) (3.0.47)\n",
-      "Collecting defusedxml\n",
-      "  Downloading defusedxml-0.7.1-py2.py3-none-any.whl (25 kB)\n",
-      "Collecting jupyterlab-pygments\n",
-      "  Downloading jupyterlab_pygments-0.3.0-py3-none-any.whl (15 kB)\n",
-      "Collecting tinycss2\n",
-      "  Downloading tinycss2-1.3.0-py3-none-any.whl (22 kB)\n",
-      "Collecting mistune<4,>=2.0.3\n",
-      "  Downloading mistune-3.0.2-py3-none-any.whl (47 kB)\n",
-      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m48.0/48.0 kB\u001b[0m \u001b[31m7.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
-      "\u001b[?25hRequirement already satisfied: markupsafe>=2.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from nbconvert->jupyter) (2.1.5)\n",
-      "Collecting pandocfilters>=1.4.1\n",
-      "  Downloading pandocfilters-1.5.1-py2.py3-none-any.whl (8.7 kB)\n",
-      "Collecting nbformat>=5.7\n",
-      "  Downloading nbformat-5.10.4-py3-none-any.whl (78 kB)\n",
-      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m78.5/78.5 kB\u001b[0m \u001b[31m9.1 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
-      "\u001b[?25hCollecting beautifulsoup4\n",
-      "  Using cached beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)\n",
-      "Collecting bleach!=5.0.0\n",
-      "  Downloading bleach-6.1.0-py3-none-any.whl (162 kB)\n",
-      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m162.8/162.8 kB\u001b[0m \u001b[31m9.7 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
-      "\u001b[?25hRequirement already satisfied: jinja2>=3.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from nbconvert->jupyter) (3.1.2)\n",
-      "Collecting nbclient>=0.5.0\n",
-      "  Downloading nbclient-0.10.0-py3-none-any.whl (25 kB)\n",
-      "Collecting jupyter-server<3,>=2.4.0\n",
-      "  Downloading jupyter_server-2.14.2-py3-none-any.whl (383 kB)\n",
-      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m383.6/383.6 kB\u001b[0m \u001b[31m12.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
-      "\u001b[?25hCollecting notebook-shim<0.3,>=0.2\n",
-      "  Downloading notebook_shim-0.2.4-py3-none-any.whl (13 kB)\n",
-      "Collecting jupyterlab-server<3,>=2.27.1\n",
-      "  Downloading jupyterlab_server-2.27.3-py3-none-any.whl (59 kB)\n",
-      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m59.7/59.7 kB\u001b[0m \u001b[31m7.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
-      "\u001b[?25hCollecting jupyterlab<4.3,>=4.2.0\n",
-      "  Downloading jupyterlab-4.2.4-py3-none-any.whl (11.6 MB)\n",
-      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m11.6/11.6 MB\u001b[0m \u001b[31m16.4 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m00:01\u001b[0m\n",
-      "\u001b[?25hCollecting qtpy>=2.4.0\n",
-      "  Downloading QtPy-2.4.1-py3-none-any.whl (93 kB)\n",
-      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m93.5/93.5 kB\u001b[0m \u001b[31m8.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
-      "\u001b[?25hRequirement already satisfied: six>=1.9.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from bleach!=5.0.0->nbconvert->jupyter) (1.16.0)\n",
-      "Collecting webencodings\n",
-      "  Downloading webencodings-0.5.1-py2.py3-none-any.whl (11 kB)\n",
-      "Requirement already satisfied: pexpect>4.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=7.23.1->ipykernel->jupyter) (4.9.0)\n",
-      "Requirement already satisfied: exceptiongroup in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=7.23.1->ipykernel->jupyter) (1.2.2)\n",
-      "Requirement already satisfied: typing-extensions>=4.6 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=7.23.1->ipykernel->jupyter) (4.12.2)\n",
-      "Requirement already satisfied: jedi>=0.16 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=7.23.1->ipykernel->jupyter) (0.19.1)\n",
-      "Requirement already satisfied: stack-data in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=7.23.1->ipykernel->jupyter) (0.6.3)\n",
-      "Requirement already satisfied: decorator in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=7.23.1->ipykernel->jupyter) (5.1.1)\n",
-      "Requirement already satisfied: python-dateutil>=2.8.2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyter-client>=6.1.12->ipykernel->jupyter) (2.9.0.post0)\n",
-      "Requirement already satisfied: platformdirs>=2.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyter-core!=5.0.*,>=4.12->ipykernel->jupyter) (4.2.2)\n",
-      "Collecting jupyter-server-terminals>=0.4.4\n",
-      "  Downloading jupyter_server_terminals-0.5.3-py3-none-any.whl (13 kB)\n",
-      "Collecting terminado>=0.8.3\n",
-      "  Downloading terminado-0.18.1-py3-none-any.whl (14 kB)\n",
-      "Collecting prometheus-client>=0.9\n",
-      "  Using cached prometheus_client-0.20.0-py3-none-any.whl (54 kB)\n",
-      "Collecting send2trash>=1.8.2\n",
-      "  Downloading Send2Trash-1.8.3-py3-none-any.whl (18 kB)\n",
-      "Collecting websocket-client>=1.7\n",
-      "  Using cached websocket_client-1.8.0-py3-none-any.whl (58 kB)\n",
-      "Collecting jupyter-events>=0.9.0\n",
-      "  Downloading jupyter_events-0.10.0-py3-none-any.whl (18 kB)\n",
-      "Collecting overrides>=5.0\n",
-      "  Using cached overrides-7.7.0-py3-none-any.whl (17 kB)\n",
-      "Requirement already satisfied: anyio>=3.1.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyter-server<3,>=2.4.0->notebook->jupyter) (4.4.0)\n",
-      "Collecting argon2-cffi>=21.1\n",
-      "  Downloading argon2_cffi-23.1.0-py3-none-any.whl (15 kB)\n",
-      "Requirement already satisfied: httpx>=0.25.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyterlab<4.3,>=4.2.0->notebook->jupyter) (0.27.0)\n",
-      "Requirement already satisfied: tomli>=1.2.2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyterlab<4.3,>=4.2.0->notebook->jupyter) (2.0.1)\n",
-      "Collecting jupyter-lsp>=2.0.0\n",
-      "  Downloading jupyter_lsp-2.2.5-py3-none-any.whl (69 kB)\n",
-      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m69.1/69.1 kB\u001b[0m \u001b[31m9.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
-      "\u001b[?25hCollecting async-lru>=1.0.0\n",
-      "  Downloading async_lru-2.0.4-py3-none-any.whl (6.1 kB)\n",
-      "Requirement already satisfied: setuptools>=40.1.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyterlab<4.3,>=4.2.0->notebook->jupyter) (71.1.0)\n",
-      "Collecting jsonschema>=4.18.0\n",
-      "  Using cached jsonschema-4.23.0-py3-none-any.whl (88 kB)\n",
-      "Collecting json5>=0.9.0\n",
-      "  Downloading json5-0.9.25-py3-none-any.whl (30 kB)\n",
-      "Requirement already satisfied: requests>=2.31 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyterlab-server<3,>=2.27.1->notebook->jupyter) (2.32.3)\n",
-      "Collecting babel>=2.10\n",
-      "  Using cached Babel-2.15.0-py3-none-any.whl (9.6 MB)\n",
-      "Collecting fastjsonschema>=2.15\n",
-      "  Downloading fastjsonschema-2.20.0-py3-none-any.whl (23 kB)\n",
-      "Requirement already satisfied: wcwidth in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from prompt-toolkit>=3.0.30->jupyter-console->jupyter) (0.2.13)\n",
-      "Collecting soupsieve>1.2\n",
-      "  Using cached soupsieve-2.5-py3-none-any.whl (36 kB)\n",
-      "Requirement already satisfied: idna>=2.8 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from anyio>=3.1.0->jupyter-server<3,>=2.4.0->notebook->jupyter) (3.7)\n",
-      "Requirement already satisfied: sniffio>=1.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from anyio>=3.1.0->jupyter-server<3,>=2.4.0->notebook->jupyter) (1.3.1)\n",
-      "Collecting argon2-cffi-bindings\n",
-      "  Downloading argon2_cffi_bindings-21.2.0-cp38-abi3-macosx_10_9_universal2.whl (53 kB)\n",
-      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m53.1/53.1 kB\u001b[0m \u001b[31m6.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
-      "\u001b[?25hRequirement already satisfied: httpcore==1.* in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from httpx>=0.25.0->jupyterlab<4.3,>=4.2.0->notebook->jupyter) (1.0.5)\n",
-      "Requirement already satisfied: certifi in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from httpx>=0.25.0->jupyterlab<4.3,>=4.2.0->notebook->jupyter) (2024.7.4)\n",
-      "Requirement already satisfied: h11<0.15,>=0.13 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from httpcore==1.*->httpx>=0.25.0->jupyterlab<4.3,>=4.2.0->notebook->jupyter) (0.14.0)\n",
-      "Requirement already satisfied: parso<0.9.0,>=0.8.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jedi>=0.16->ipython>=7.23.1->ipykernel->jupyter) (0.8.4)\n",
-      "Collecting rpds-py>=0.7.1\n",
-      "  Downloading rpds_py-0.19.1-cp310-cp310-macosx_11_0_arm64.whl (310 kB)\n",
-      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m310.4/310.4 kB\u001b[0m \u001b[31m14.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
-      "\u001b[?25hRequirement already satisfied: attrs>=22.2.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jsonschema>=4.18.0->jupyterlab-server<3,>=2.27.1->notebook->jupyter) (23.2.0)\n",
-      "Collecting referencing>=0.28.4\n",
-      "  Using cached referencing-0.35.1-py3-none-any.whl (26 kB)\n",
-      "Collecting jsonschema-specifications>=2023.03.6\n",
-      "  Using cached jsonschema_specifications-2023.12.1-py3-none-any.whl (18 kB)\n",
-      "Requirement already satisfied: pyyaml>=5.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter) (6.0.1)\n",
-      "Collecting rfc3986-validator>=0.1.1\n",
-      "  Downloading rfc3986_validator-0.1.1-py2.py3-none-any.whl (4.2 kB)\n",
-      "Collecting python-json-logger>=2.0.4\n",
-      "  Downloading python_json_logger-2.0.7-py3-none-any.whl (8.1 kB)\n",
-      "Collecting rfc3339-validator\n",
-      "  Downloading rfc3339_validator-0.1.4-py2.py3-none-any.whl (3.5 kB)\n",
-      "Requirement already satisfied: ptyprocess>=0.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pexpect>4.3->ipython>=7.23.1->ipykernel->jupyter) (0.7.0)\n",
-      "Requirement already satisfied: urllib3<3,>=1.21.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests>=2.31->jupyterlab-server<3,>=2.27.1->notebook->jupyter) (2.0.7)\n",
-      "Requirement already satisfied: charset-normalizer<4,>=2 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from requests>=2.31->jupyterlab-server<3,>=2.27.1->notebook->jupyter) (3.3.2)\n",
-      "Requirement already satisfied: pure-eval in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=7.23.1->ipykernel->jupyter) (0.2.3)\n",
-      "Requirement already satisfied: executing>=1.2.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=7.23.1->ipykernel->jupyter) (2.0.1)\n",
-      "Requirement already satisfied: asttokens>=2.1.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=7.23.1->ipykernel->jupyter) (2.4.1)\n",
-      "Collecting jsonpointer>1.13\n",
-      "  Using cached jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB)\n",
-      "Collecting fqdn\n",
-      "  Downloading fqdn-1.5.1-py3-none-any.whl (9.1 kB)\n",
-      "Collecting webcolors>=24.6.0\n",
-      "  Downloading webcolors-24.6.0-py3-none-any.whl (14 kB)\n",
-      "Collecting uri-template\n",
-      "  Downloading uri_template-1.3.0-py3-none-any.whl (11 kB)\n",
-      "Collecting isoduration\n",
-      "  Downloading isoduration-20.11.0-py3-none-any.whl (11 kB)\n",
-      "Requirement already satisfied: cffi>=1.0.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from argon2-cffi-bindings->argon2-cffi>=21.1->jupyter-server<3,>=2.4.0->notebook->jupyter) (1.16.0)\n",
-      "Requirement already satisfied: pycparser in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from cffi>=1.0.1->argon2-cffi-bindings->argon2-cffi>=21.1->jupyter-server<3,>=2.4.0->notebook->jupyter) (2.22)\n",
-      "Collecting arrow>=0.15.0\n",
-      "  Downloading arrow-1.3.0-py3-none-any.whl (66 kB)\n",
-      "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m66.4/66.4 kB\u001b[0m \u001b[31m8.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
-      "\u001b[?25hCollecting types-python-dateutil>=2.8.10\n",
-      "  Downloading types_python_dateutil-2.9.0.20240316-py3-none-any.whl (9.7 kB)\n",
-      "Installing collected packages: webencodings, fastjsonschema, widgetsnbextension, websocket-client, webcolors, uri-template, types-python-dateutil, tinycss2, terminado, soupsieve, send2trash, rpds-py, rfc3986-validator, rfc3339-validator, qtpy, python-json-logger, prometheus-client, pandocfilters, overrides, mistune, jupyterlab-widgets, jupyterlab-pygments, jsonpointer, json5, fqdn, defusedxml, bleach, babel, async-lru, referencing, jupyter-server-terminals, beautifulsoup4, arrow, argon2-cffi-bindings, jsonschema-specifications, isoduration, argon2-cffi, jsonschema, ipywidgets, qtconsole, nbformat, jupyter-console, nbclient, jupyter-events, nbconvert, jupyter-server, notebook-shim, jupyterlab-server, jupyter-lsp, jupyterlab, notebook, jupyter\n",
-      "Successfully installed argon2-cffi-23.1.0 argon2-cffi-bindings-21.2.0 arrow-1.3.0 async-lru-2.0.4 babel-2.15.0 beautifulsoup4-4.12.3 bleach-6.1.0 defusedxml-0.7.1 fastjsonschema-2.20.0 fqdn-1.5.1 ipywidgets-8.1.3 isoduration-20.11.0 json5-0.9.25 jsonpointer-3.0.0 jsonschema-4.23.0 jsonschema-specifications-2023.12.1 jupyter-1.0.0 jupyter-console-6.6.3 jupyter-events-0.10.0 jupyter-lsp-2.2.5 jupyter-server-2.14.2 jupyter-server-terminals-0.5.3 jupyterlab-4.2.4 jupyterlab-pygments-0.3.0 jupyterlab-server-2.27.3 jupyterlab-widgets-3.0.11 mistune-3.0.2 nbclient-0.10.0 nbconvert-7.16.4 nbformat-5.10.4 notebook-7.2.1 notebook-shim-0.2.4 overrides-7.7.0 pandocfilters-1.5.1 prometheus-client-0.20.0 python-json-logger-2.0.7 qtconsole-5.5.2 qtpy-2.4.1 referencing-0.35.1 rfc3339-validator-0.1.4 rfc3986-validator-0.1.1 rpds-py-0.19.1 send2trash-1.8.3 soupsieve-2.5 terminado-0.18.1 tinycss2-1.3.0 types-python-dateutil-2.9.0.20240316 uri-template-1.3.0 webcolors-24.6.0 webencodings-0.5.1 websocket-client-1.8.0 widgetsnbextension-4.0.11\n",
-      "\n",
-      "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip is available: \u001b[0m\u001b[31;49m23.0.1\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m24.1.2\u001b[0m\n",
-      "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpip install --upgrade pip\u001b[0m\n"
-     ]
-    },
-    {
-     "name": "stderr",
-     "output_type": "stream",
-     "text": [
-      "huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...\n",
-      "To disable this warning, you can either:\n",
-      "\t- Avoid using `tokenizers` before the fork if possible\n",
-      "\t- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)\n"
-     ]
-    },
-    {
-     "name": "stdout",
-     "output_type": "stream",
-     "text": [
-      "Requirement already satisfied: ipywidgets in /Users/gyliu/pr-agent/lib/python3.10/site-packages (8.1.3)\n",
-      "Requirement already satisfied: jupyterlab-widgets~=3.0.11 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipywidgets) (3.0.11)\n",
-      "Requirement already satisfied: comm>=0.1.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipywidgets) (0.2.2)\n",
-      "Requirement already satisfied: ipython>=6.1.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipywidgets) (8.26.0)\n",
-      "Requirement already satisfied: widgetsnbextension~=4.0.11 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipywidgets) (4.0.11)\n",
-      "Requirement already satisfied: traitlets>=4.3.1 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipywidgets) (5.14.3)\n",
-      "Requirement already satisfied: exceptiongroup in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (1.2.2)\n",
-      "Requirement already satisfied: pygments>=2.4.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (2.18.0)\n",
-      "Requirement already satisfied: jedi>=0.16 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (0.19.1)\n",
-      "Requirement already satisfied: stack-data in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (0.6.3)\n",
-      "Requirement already satisfied: typing-extensions>=4.6 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (4.12.2)\n",
-      "Requirement already satisfied: decorator in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (5.1.1)\n",
-      "Requirement already satisfied: matplotlib-inline in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (0.1.7)\n",
-      "Requirement already satisfied: prompt-toolkit<3.1.0,>=3.0.41 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (3.0.47)\n",
-      "Requirement already satisfied: pexpect>4.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from ipython>=6.1.0->ipywidgets) (4.9.0)\n",
-      "Requirement already satisfied: parso<0.9.0,>=0.8.3 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from jedi>=0.16->ipython>=6.1.0->ipywidgets) (0.8.4)\n",
-      "Requirement already satisfied: ptyprocess>=0.5 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from pexpect>4.3->ipython>=6.1.0->ipywidgets) (0.7.0)\n",
-      "Requirement already satisfied: wcwidth in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from prompt-toolkit<3.1.0,>=3.0.41->ipython>=6.1.0->ipywidgets) (0.2.13)\n",
-      "Requirement already satisfied: executing>=1.2.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=6.1.0->ipywidgets) (2.0.1)\n",
-      "Requirement already satisfied: pure-eval in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=6.1.0->ipywidgets) (0.2.3)\n",
-      "Requirement already satisfied: asttokens>=2.1.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from stack-data->ipython>=6.1.0->ipywidgets) (2.4.1)\n",
-      "Requirement already satisfied: six>=1.12.0 in /Users/gyliu/pr-agent/lib/python3.10/site-packages (from asttokens>=2.1.0->stack-data->ipython>=6.1.0->ipywidgets) (1.16.0)\n",
-      "\n",
-      "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip is available: \u001b[0m\u001b[31;49m23.0.1\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m24.1.2\u001b[0m\n",
-      "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpip install --upgrade pip\u001b[0m\n"
-     ]
-    }
-   ],
-   "source": [
-    "!pip install --upgrade jupyter\n",
-    "!pip install --upgrade ipywidgets"
-   ]

milvus #184

milvus #184

Conversation

gyliu513 commented Jul 25, 2024 • edited by coderabbitai bot Loading

PR Type

Description

Changes walkthrough 📝

Summary by CodeRabbit

coderabbitai bot commented Jul 25, 2024 • edited Loading

Walkthrough

Changes

Sequence Diagram(s)

Poem

Chat

CodeRabbit Commands (invoked as PR comments)

CodeRabbit Configuration File (.coderabbit.yaml)

Documentation and Community

github-actions bot commented Jul 25, 2024

PR Reviewer Guide 🔍

github-actions bot commented Jul 25, 2024 • edited Loading

PR Code Suggestions ✨

coderabbitai bot left a comment

Choose a reason for hiding this comment

coderabbitai bot Jul 25, 2024

Choose a reason for hiding this comment

coderabbitai bot Jul 25, 2024

Choose a reason for hiding this comment

coderabbitai bot Jul 25, 2024

Choose a reason for hiding this comment

coderabbitai bot Jul 25, 2024

Choose a reason for hiding this comment

gyliu513 commented Jul 25, 2024 •

edited by coderabbitai bot

Loading

coderabbitai bot commented Jul 25, 2024 •

edited

Loading

CodeRabbit Configuration File (`.coderabbit.yaml`)

github-actions bot commented Jul 25, 2024 •

edited

Loading