Debezium 是一个变更数据捕获(Change Data Capture, CDC) 平台,可以将数据库变更流式传输到Kafka 的 topics。 CDC是一种流行的技术,具有多种应用场景,例如:将数据复制到其他数据库、输送数据给分析系统、从单体中提取数据至微服务以及废除缓存。 Debezium 对数据库日志文件中的变更做出反应,并具有多个CDC连接器,适用于多种数据库,其中包括Postgres、MySQL、Oracle 和 MongoDB。 我们在许多项目中都使用了Debezium,它对我们来说非常有效。
Debezium is a change data capture (CDC) platform that can stream database changes onto Kafka topics. CDC is a popular technique with multiple use cases, including replicating data to other databases, feeding analytics systems, extracting microservices from monoliths and invalidating caches. We're always on the lookout for tools or platforms in this space (we talked about Bottled Water in a previous Radar) and Debezium is an excellent choice. It uses a log-based CDC approach which means it works by reacting to changes in the database's log files. Debezium uses Kafka Connect which makes it highly scalable and resilient to failures and has CDC connectors for multiple databases including Postgres, Mysql and MongoDB. We're using it in a few projects and it has worked very well for us.