action: update always errors out

[arvin6msd]

output {
  amazon_es {
    hosts => ["https://xyz.us-east-1.es.amazonaws.com"]
    index => "abc_%{+YYYY.ww}"
    retry_on_conflict => 5
    action => update
    region => "us-east-1"
    ssl => true
    document_id => "%{some_id}"
    doc_as_upsert => true
    manage_template => false
  }

The above configuration errors out with

logstash-v1-0 logstash [2021-04-12T16:13:27,003][ERROR][logstash.outputs.amazonelasticsearch][xyz_pipeline][fb31f5d1d0aa0c82a8d3877a37718bea053f75981e8f3fc872988391492bc95c] Encountered a retryable error. Will Retry with exponential backoff  {:code=>400, :url=>"https://xyz.us-east-1.es.amazonaws.com:443/_bulk"}

[arvin6msd]

when I remove action: update the same configuration works but it tends to replace the whole document as opposed to partial update.

[arvin6msd]

I cannot replicate this in logstash-output-elasticsearch. So I think it is specific to this plugin.

[rodrigorjo]

I have the same problem. Removing action => update works, but it overwrites the whole document.
Trying to use upsert script, but it wont work since it needs action => update

[SlashTec]

have u solved this issue ?