📓
BK Tricks
<- back to the bodik.tech
  • BK Tricks
  • AI\ML
    • Using PostgreSQL with pgvector extension to store and search embeddings
    • JavaScript-based tools
  • Databases
    • PostgreSQL
      • How to Use HOT Updates in PostgreSQL to Boost Your UPDATE Queries
      • Maximizing the Potential of Embeddings with PGvector: A Comprehensive Guide
    • Elasticsearch
      • The impact of Elasticsearch segments on search speed
      • How to aggregate Elasticsearch results by the timestamp on day interval?
      • Mastering Vector Search in Elasticsearch: Mapping Index for KNN
    • Prometheus
      • What is Prometheus and what is it usually used for?
      • How to create a simple Prometheus exporter?
    • Clickhouse
      • How to make a difference of two arrays in ClickHouse?
      • Materialized View that parses JSON or nested JSON from the string field of another table
      • Attach S3 as a storage engine to ClickHouse
      • Table with TTL to S3
      • Partition ClickHouse table based on unique string hash
      • Create a connection to other ClickHouse instance
  • Infrastructure
    • AWS
      • SAM
        • Schema to create a resource of DynamoDB table using SAM
        • Example of enabling streaming functionality of DynamoDB table using SAM resource
        • Schema to create Lambda function resource using SAM
        • Adding environment variables to Lambda function resource using SAM
        • Adding a scheduled timer to start Lambda function resource using SAM
        • Reading stream from DynamoDB by Lambda function declared using SAM
        • Schema to create a resource of SQS queue using SAM
      • CloudFront
        • How to make redirect using Lambda@Edge?
  • Programming
    • JavaScript
      • Convert hexadecimal string to an array of Uint8 values
      • How to decrypt data encoded with NaCl cryptographic algorithm using NodeJS?
      • How to add a property to JavaScript object if it is not empty or null?
  • Tools
    • Kafka
      • Useful tools
      • How to view all of the offsets for some consumer groups in Kafka using CLI?
      • How to set Kafka offsets of a consumer group to a predefined list for all partitions at once?
  • Math
    • Transform the number from one numeric range to another
  • Frontend
    • Useful resources
Powered by GitBook
On this page
  • Kafka UI
  • LinkedIn's Cruise Control
  1. Tools
  2. Kafka

Useful tools

If you are using Apache Kafka for your data streaming needs, there are a couple of useful tools that can assist you in managing and monitoring your Kafka clusters.

PreviousKafkaNextHow to view all of the offsets for some consumer groups in Kafka using CLI?

Last updated 1 year ago

Kafka UI

One such tool is Kafka UI. Kafka UI provides a user-friendly interface that allows you to easily navigate and interact with your Kafka topics, partitions, and consumer groups. With Kafka UI, you can view real-time metrics, monitor message consumption, and perform administrative tasks such as creating topics and managing consumer offsets. It simplifies the management of Kafka clusters and makes it easier for you to ensure optimal performance and reliability.

Learn more about Kafka UI .

LinkedIn's Cruise Control

Another powerful tool for managing and optimizing Kafka clusters is LinkedIn's Cruise Control. This tool is specifically designed for use with Amazon Managed Streaming for Apache Kafka (MSK). Cruise Control automates capacity planning, workload rebalancing, and performance optimization. It offers features like automatic workload and partition rebalancing, anomaly detection, and self-healing capabilities. By using Cruise Control, you can effectively manage and monitor your Kafka clusters for optimal performance and reliability.

For more information on how to use LinkedIn's Cruise Control for Apache Kafka with Amazon MSK, refer to the .

official documentation
here
AboutUI for Apache Kafka
Using LinkedIn's Cruise Control for Apache Kafka with Amazon MSK - Amazon Managed Streaming for Apache KafkaAmazon Managed Streaming for Apache Kafka
Logo
Logo