mwax_subfile_distributor config file

mwax_subfile_distributor config file

[mwax mover] section

This section of the config file is global for all MWAX hosts.

log_path

• A relative (to the current working dir) or absolute path to a directory where logs will be written. The directory must exist. Any existing log file will be appended to.
• Example: log_path=./logs

webserver_port

• The http port that the inbuilt web service will listen.
• Example: webserver_port=9999

health_multicast_interface_name

• The network interface name that will be used to send multicast UDP health packets.
• Example: health_multicast_interface_name=eth0

health_multicast_ip

• The multicast IP address to send health packets.
• Example: health_multicast_ip=224.234.0.0

health_multicast_port

• The multicast port to send health packets.
• Example: health_multicast_port=8005

health_multicast_hops

• The number of hops the multicast should be allowed to traverse. Include all switches and routers when counting.
• Example: health_multicast_hops=1

subfile_incoming_path

• The directory where mwax_u2s will deposit new .sub files. The directory must exist.
• Example: subfile_incoming_path=/data/dev/shm

voltdata_incoming_path

• The directory to place .sub files so they can be archived. The directory must exist.
• Example: voltdata_incoming_path=/data/voltdata/incoming

voltdata_outgoing_path

• The directory where .sub files are moved once they have been checksummed and added to the data_files table in the MWA database. From here they will be transferred to the mwacache servers via xrootd. The directory must exist.
• Example: voltdata_outgoing_path=/data/voltdata/outgoing

visdata_dont_archive_path

• When archiving_enabled=0 or archive_destination_enabled=0 in this server's staza (i.e. this host is not archiving), move correlator files to this directory instead of archiving. This can be useful when testing. The directory must exist.
• Example: visdata_dont_archive_path=/tmp

voltdata_dont_archive_path

• When archiving_enabled=0 or archive_destination_enabled=0 in this server's staza (i.e. this host is not archiving), move subfiles files to this directory instead of archiving. This can be useful when testing. The directory must exist.
• Example: voltdata_dont_archive_path=/tmp

archive_command_timeout_sec

• When sending data to the mwacache servers via xrootd, wait this many seconds before treating the transfer as failed.
• Example: archive_command_timeout_sec=300

psrdada_timeout_sec

• When loading .sub files into the PSRDADA input ringbuffer for correlation, specify that it should wait this number of seconds before treating the PSRDADA operation as a failure.
• Example: psrdada_timeout_sec=32

copy_subfile_to_disk_timeout_sec

• When copying .sub files from the subfile_incoming_path to the voltdata_incoming_path allow the copy to run for this number of seconds before treating the copy as a failure.
• Example: copy_subfile_to_disk_timeout_sec=120

archiving_enabled

• This is a master switch to disable archiving. If 0, then no archiving will occur, even if archive_destination_enabled=1 in the host's stanza is specified. When 1, the decision to archive or not is per host in the archive_destination_enabled setting of the host's stanza.
• Example: archiving_enabled=1

high_priority_correlator_projectids

• When queuing correlator files to archive, which correlator projects should be considered highest priority. A comma separated list of project ids or leave blank.
• Example: high_priority_correlator_projectids=D0006,C001

high_priority_vcs_projectids

• When queuing sub files to archive, which VCS projects should be considered highest priority. A comma separated list of project ids or leave blank.
• Example: high_priority_vcs_projectids=