How to maintain data consistency between the database and Manticore Search？

[guofengzh]

We store data in the database, and at the same time we store the data in Manticore Search for fast search. To keep the data consistency, we think we should use global transcation (XA transcation).

But although Manticore Search support the mysql wire protocol, but it seems that It does not support MysqlXADataSource.

We use Narayana transaction toolkit and MysqlXADataSource for testing. We got the following exception:

com.mysql.cj.jdbc.MysqlXAException: Undetermined error occurred in the underlying Connection - check your data for consistency
...
Caused by: java.sql.SQLSyntaxErrorException: P02: syntax error, unexpected identifier near 'XA START 0x00000000000000000000ffff7f0001010000965b670f7c900000001131,0x00000000000000000000ffff7f0001010000965b670f7c90000000140000000200000000,0x20005'

Does Manticore search really not support Mysql XA datasource? If this is the case, how to ensure data consistency between multiple data stores for our situation?

Thanks for your help!

[sanikolaev]

Hello @guofengzh

Manticore doesn't support XA. The easiest way to sync data between MySQL and Manticore is the main+delta schema - https://manual.manticoresearch.com/Data_creation_and_modification/Adding_data_from_external_storages/Main_delta#Main+delta-schema

Interactive course about it - https://play.manticoresearch.com/maindelta/