展开查看详情
1 .Milvus Deep Dive#2
APIs and Python SDKs
Xuan Yang
xuan.yang@zilliz.com
2 . Xuan Yang
- Zilliz software engineering
- Graduated from WHU
- In charge of PyMilvus and Milvus DataNode
- Crazy fan of open-source community PyMilvus-admin
- Crazy fan of Vim Milvus-contributor
3 .WhyAPIs and Python SDK?
4 . gRPC
SDKs Milvus
Milvus protocol API
5 . PyMilvus
Nodejs SDK
Java SDK milvus.proto
common.proto Milvus
schema.proto
Go SDK
Restful APIs
CPP SDK
Milvus SDK roadmap
https://milvus.io/docs/v2.0.0/roadmap.md#SDK
6 . What’s
the actual behavior of Milvus
milvus.proto
How common.proto New features
schema.proto
PyMilvus uses those APIs in PyMilvus combined by different APIs
New SDK
implementation
7 .O bject R elational M apping
PyMilvus 2.0
9 .Milvus protocol API
milvus.proto
common.proto
schema.proto
10 . milvus.proto common.proto schema.proto
milvus.proto
...
service MilvusService{
...
rpc CreatePartition(CreatePartitionRequest) returns (common.Status) {}
...
}
...
message CreatePartitionRequest {
...
string collection_name = 3;
string partition_name = 4;
}
...
11 . milvus.proto common.proto schema.proto
common.proto
message Status {
ErrorCode error_code = 1;
string reason = 2;
}
12 . milvus.proto common.proto schema.proto
schema.proto
message CollectionSchema {
string name= 1;
string description = 2;
bool autoID = 3;
repeated FieldSchema fields = 4;
}
13 . Combination of APIs
create_index() as an example
rpc DescribeCollection()
rpc CreateIndex()
rpc GetIndexState()
What you want
might not even need to change the behavior of Milvus server.
15 .PyMilvus 2.0
ORM —— More in one
ORM-style API
Documentations
Roadmaps
16 .ORM —— More in one ORM-style API Documentations Roadmaps
Object-Relational Mapping
Operate directly on objects.
Isolate business logic and data access details.
Hide the implementation complexity, same codes everywhere.
17 .ORM —— More in one ORM-style API Documentations Roadmaps
Hide the implementation complexity, same codes everywhere.
PyMilvus
Milvus as a DBS
rpc
ORM-style
cython Milvus as a library
codes
...
Milvus as a cloud service
18 . ORM —— More in one ORM-style API Documentations Roadmaps
Control connections to Milvus
...
connections.add_connection(
Add Milvus addresses dev={“host”: “localhost”, “port”: “19530”},
cloud={“host”: “xxx.xxx.xxx”, ”port”: “xxxxxx”},
)
Connect to one server
using alias “dev” connections.connect(“dev”)
Disconnect to the
server using alias “dev” connections.disconnect(“dev”)
Remove one address connections.remove_connection(“dev”)
using alias “dev”
19 . ORM —— More in one ORM-style API Documentations Roadmaps
Operating directly on Collections, Partitions, and Indexes
...
Binding Collection films = Collection(“films”, ..., using=“dev”)
object with connection
films.name
Collection object has states films.description
films.num_entities
...
films.insert(...)
films.load()
Operate on the
Collection object films.search(...)
films.query(...)
20 . ORM —— More in one ORM-style API Documentations Roadmaps
Operating directly on Collections, Partitions, and Indexes
...
Create a partition in adventure = films.create_partition(“adventure”)
films collection
adventure.name
adventure.description
Partition object has states
adventure.is_empty
...
adventure.insert(...)
adventure.load()
Operate on the
Partition object adventure.search(...)
adventure.release(...)
21 . ORM —— More in one ORM-style API Documentations Roadmaps
Operating directly on Collections, Partitions, and Indexes
...
Create index for ivf_flat = films.create_index(...)
collection films
ivf_flat.collection_name
ivf_flat.params
Index object has
states ivf_flat.field_name
...
Operate on the Index ivf_flat.drop()
object
all_partitions = films.partitions()
More states on adventure = films.partition(“adventure”)
Collection object ivf_flat = films.index()
22 .ORM —— More in one ORM-style API Documentations Roadmaps
1. Auto-generated from API doc-strings
23 .ORM —— More in one ORM-style API Documentations Roadmaps
2. Written by contributors
24 .ORM —— More in one ORM-style API Documentations Roadmaps
All documentations avaliable at API Reference section
https://milvus.io/docs/home
Doc sources avaliable at
https://github.com/milvus-io/pymilvus/tree/master/docs
25 .ORM —— More in one ORM-style API Documentations Roadmaps
PyMilvus as a DBS SDK PyMilvus as a library: PyMilvus as a cloud service SDK
local-index and ANNS
Merge of PyMilvus and
PyMilvus-ORM repo
MEP 3 Merge PyMilvus and PyMilvus-ORM repository
On July 20th, 2021 Milvus 1st tech meeting
27 .Thank You
https://milvus.io
https://github.com/milvus-io/milvus
扫码加入直播交流群 关注 Milvus 视频号
https://github.com/milvus-io/pymilvus 与讲师实时QA 直播视频早知道
https://twitter.com/milvusio
热门城市
