Pulsarctl & Pulsar Manager
•
0 likes•533 views
This document discusses using pulsarctl and pulsar-manager to manage a Pulsar cluster. It introduces pulsarctl as a CLI tool developed in Go for managing Pulsar clusters that addresses some issues with the existing Pulsar admin tool. It then covers how to use the Admin API and CLI features of pulsarctl. Finally, it outlines some future plans, including adding more features to pulsarctl and pulsar-manager.
Pulsarctl & Pulsar Manager
- 1. 冉⼩⻰ 俄⼴宁 使⽤ pulsarctl 和 pulsar-manager 管理 pulsar 集群 2019/11/16
- 2. Who am I • Go programmer • PingCAP > Bitmain > StreamNative • Pulsar committer ◦ pulsar-client-go ◦ Go Functions ◦ … • https://github.com/wolfstudy
- 3. 01 Why develop pulsarctl 02 What is pulsarctl 03 How to use Admin Api 04 How to use CLI 05 How to contribute 06 Future Pulsarctl
- 4. Why develop pulsarctl • Apache Pulsar 是云原⽣的分布式系统 • pulsar admin 存在的问题 • 依赖多，需要加载JVM环境 • 描述信息不全 • 不易于 debug
- 5. 基于 REST API 使⽤ Go 语⾔开发的⼀个 CTL ⼯具 What is pulsarctl Go Admin API Command-cli tools pulsarctl
- 6. How to use Admin Api https://godoc.org/github.com/streamnative/pulsarctl
- 7. How to use Admin Api Cluster.List() instantiate a admin object Call interface 1 2 https://github.com/streamnative/pulsarctl/blob/master/examples.go
- 8. How to use CLI • Used for : 对该命令的使⽤场景进⾏描述 • Required Permission：使⽤该命令所需要的 权限 • Output：列出使⽤该命令所有的输出信息，包 括正确的输出和错误的输出 • Examples：列出命令的使⽤示例 • Flags: 该命令所需要的所有参数列表 https://streamnative.io/docs/pulsarctl/v0.1.0/
- 9. pulsarctl VS pulsar admin 废弃 json string, 使⽤特殊字符代替
- 10. pulsarctl VS pulsar admin 拆分 topics commands subscriptions topics
- 11. pulsarctl VS pulsar admin 整合 topics commands partition topic topic
- 13. Feature https://github.com/streamnative/pulsarctl/issues • Add pulsarctl to Homebrew • Add context for pulsarctl • Add bookkeeper cli • Separate policies from subscriptions • Support different ways to dump result • …
- 14. Thanks Q & A
- 15. Who am I • Java && Python programmer • Creditease > Meituan > StreamNative • Pulsar committer ◦ Pulsar Connector ◦ Pulsar Manager ◦ … • https://github.com/tuteng
- 16. 01 Motivation 02 Operation 03 Doing 04 Future Contents
- 17. Motivation 01
- 18. Motivation Dashboard Pulsar-managerVS • Focus on simple monitoring • Weak management • Multi-cluster is not supported • Focus on management • Simple monitoring • Multi-cluster, multi-environment management • More suitable for cloud • JWT authentication authorization and management • Deployment simple
- 19. Operation 02
- 20. Operation
- 22. Multiple clusters • Geo replication • Global tenants, namespace • Topics management by cluster
- 23. Clusters management • Set basic configuration • Set failure domains • Isolation policies
- 25. Tenants management • Create Tenant • Delete Tenant • Update Configuration
- 27. Namespaces management • Create Namespace • Delete Namespace • Update Policies
- 29. Topics management • More info(Storage, segment, cursor) • Create Topic(Persistent, non-persistent) • Delete Topic • Update Configuration • Topics monitor(Aggregated data)
- 31. Topics monitor
- 32. Subscription management • Consumer information • Backlog skip • Backlog clear • Backlog expire • Reset cursor
- 34. Authentication and authorization • JWT tokens management • Namespace grant permission • Topic grant permission
- 36. Deployment • Docker • K8s • Self build
- 37. Doing 03
- 39. Authentication and authorization • User management • Role management • Deep into with multi tenant • More detailed permission design
- 41. Future 04
- 42. Future • Aggregated data for tenants, namespaces • Support large of topics(search, query, page) • Bookies management
- 43. Thanks