Kafka queues do not support special characters in source field names

[djklim87]

Bug Description:

When creating a source to read from Kafka queues, we need to iterate through the fields of the incoming message (JSON). In JSON, it’s acceptable for keys to contain $ or other special characters, but such characters are completely prohibited in Manticore fields. This needs to be handled appropriately

CREATE SOURCE wiki_source (id bigint, $schema json) 
type='kafka' 
broker_list='kafka:9092' 
topic_list='wikimedia' 
consumer_group='ms_wikimedia' 
num_consumers='4' 
batch=200

Manticore Search Version:

6.3.8

Operating System Version:

Any

Have you tried the latest development version?

None

Internal Checklist:

^{To be completed by the assignee. Check off tasks that have been completed or are not applicable.}

• Implementation completed
• Tests developed
• Documentation updated
• Documentation reviewed
• Changelog updated

[djklim87]

Blocked by manticoresoftware/manticoresearch-buddy#421