Worker vs Connector vs Task When I read the Kafka Connect source code, the relationship between worker, connector and task confused me. Confluent has a nice illustration about their relationship. ...

list topics ./bin/kafka-topics.sh --bootstrap-server localhost:9092 --list ./bin/kafka-topics.sh --describe --bootstrap-server localhost:9092 --topic filebeat ./bin/kafka-run-class.sh kafka.tools....

First question: what is the unit of timestamp inside Kafka repo. The Long timestamp variable shows everywhere inside Kafka repo. What is its unit? Take a step back. The timestamp must come from the...

Recently, I was revisiting the C++ std::time function and suddenly get triggered by the std::time_t type. Quoted from cppreference, Although not defined, this is almost always an integral value...

Configurations tidb_mem_quota_query: each query has a memory limit, default is 1GB. Lighting Mydumps file pattern code.

Kafka protocol Kafka has its own binary protocol built on top of TCP to allow clients to talk to it. See the official documentation. There are less than twenty request types (ApiKey) in total, so ...

Problem statement Our company uses sqlalchemy + aiomysql, and sometimes we see blow error. Not sure what happens aiomysql version is 0.2.0. File "sqlalchemy/pool/base.py", line 894, in _checko...

asyncio.create_subprocess_exec() and asyncio.create_subprocess_shell() are the async counterparty of subprocess.Popen in the multi-process world. For each subprocess, it creates a thread to watch ...

Dis Output interpretation This stackoverflow post has a great diagram: For a sample code from asyncio import sleep async def f(): await sleep(0) We have below disassembled bytecode. (1)|...

Generator Follow below peps to understand semantics of generator and async/await. Also, see https://asyncio-notes.readthedocs.io/en/latest/asyncio-history.html for the history of asyncio. Another ...