S earch service for OpenStack Image source httpswwwflickrcomphotosnasahqphoto15757310289 Lei Zhang Searchlight includes indexing plugins for many of Openstacks core services This session will focus ID: 558979
Download Presentation The PPT/PDF document "Searchlight" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Searchlight
Search service for OpenStack
Image source: https://www.flickr.com/photos/nasahqphoto/15757310289
Lei ZhangSlide2
Searchlight includes indexing plugins for many of Openstack's core services. This session will focus
on:Concept overviewArchitecture overview
Aggregations abilities and
exampleSearchlight UI showOcata goalsSlide3
Managing Clouds
Is managing relationships between things
Power off all of Bob’s instances
What flavors work for encryption workloads?
What resources are tagged with “web”?
What am I using in the East availability zone?Slide4
The CLI
Pre-defined lists for all the things
Availability ZonesBaremetal Nodes
DomainsFlavors
Floating IPs
Host Aggregates
Hypervisors
Images
Instances
Key Pairs
Metadata Definitions
Networks
Projects
Routers
Security Groups
Subnets
Volumes
...Slide5
The UI
Pre-defined lists for all the thingsSlide6
Predefined lists are one way to do it…
List of things
Details of one thing
List of things
Details of one thing
List of things
Details of one thingSlide7
What about
MYlist of things?
CloudRequires
SearchSlide8
OpenStack is a set of distributed services
SearchlightUnified SearchBased on Elasticsearch
Powerful search and aggregation APIFull text search on any resource
Support search for Nova, Neutron, Cinder, Glance, Swift, Designate resourcesCLI and Horizon UISlide9
Searchlight
Resources indexed:
On demand bulk indexingVia notifications
Direct Injection Libraries
UIs and API Clients
Action Requests
List and Query Requests
plugins
Concept
Flow
Cloud ServicesSlide10
ComponentsSlide11
Plugin architecture
Searchlight Core Engine
Zero Downtime Bulk Indexing (to [re-]initialize data)
Incremental Indexing (ongoing)
Rich Policy Based Access Controls
Per User Field Level Data
Security
Resource Plugin
Data Mapping
Retrieves resources from source service API
Transforms event notifications
Defines resource RBAC rules
Keystone (auth)
RMQ / Oslo.messaging
NovaSlide12
Improve
theNotificationsavoid api callbacksNotifications in OpenStack are spottymissing eventsmissing dataSlide13
Aggregations
Provide aggregated data based on a search queryCan be composed in order to build complex summaries of the data.
Based on the query provided as well as Searchlight RBAC filters.Slide14
How many volumes and how many gigabytes does each project use?
{ "query": {"match_all": {}}, "type": "OS::Cinder::Volume", "limit": 0, "all_projects": true, "aggregations": {
"volumes_by_tenant": { "terms": { "field": "project_id"
}, "aggregations": { "total_volume_gb": { "sum": { "field": "size"
}
}}}}}
{
"volumes_by_tenant": {
"buckets": [
{
"doc_count": 2,
"key": "a3845ef5d597426086980afeed4838a9",
"total_volume_gb": {
"value": 4.0
}
},
{
"doc_count": 2,
"key": "b1fbc598025841899f63333269abe1d2",
"total_volume_gb": {
"value": 3.0
}
},
Slide15
Searchlight UI
Plugging resource types into the interfaceWeb front-end to SearchlightIs a plugin to Horizon
Repo: searchlight-uiAngularJS
~2,000 LOC (JS)Uses Neutron HorizonSlide16Slide17Slide18Slide19Slide20Slide21Slide22Slide23Slide24Slide25
Ocata
list Add more service plugins: Ironic, Murano, Glare, Magnum, Lbaas(Octavia), HeatProvide sort and pagination support for Nova cell
v2Implement pipeline for Searchlight, allow arbitrary publishers can be added into Searchlight
Zaqar publisher(Searchlight Zaqar Horizon integration)Slide26
M
ore infohttp://docs.openstack.org/developer/searchlight/https://blueprints.launchpad.net/searchlight