@jordanpadams @tloubrieu-jpl

I think we have been doing this all along. harvest only uses the bulk interface. It has always use the "index" on the bulk command when adding a document. Interestingly, this means that if it exists, then overwrite it otherwise create it and has been this way since opensearch 1.0

@al-niessner hmmm. did we ever do some filtering to prune down what actually makes it into the bulk upload?

I feel like we definitely had a "skipped" log message, which skipped products.

@jordanpadams @tloubrieu-jpl

Code blame claims has not changed in two years (specifically lines 26-43):
https://github.com/NASA-PDS/registry-common/blame/main/src/main/java/gov/nasa/pds/registry/common/util/json/NJsonDocUtils.java

@al-niessner not sure how/where the "skipped" functionality was implemented in the past, but it was at least logging it as such from the very beginning. are we saying we have been logging it as skipped, but then not actually skipping anything?

@jordanpadams

Sorry I had found it and created PR that fixes it but typed the issue wrong in the PR so it did not connect.