Skip to content

Change m365 lookback days to 0 and number of worker threads to 7#6095

Merged
san81 merged 1 commit into
opensearch-project:mainfrom
wjyao0316:m365
Sep 22, 2025
Merged

Change m365 lookback days to 0 and number of worker threads to 7#6095
san81 merged 1 commit into
opensearch-project:mainfrom
wjyao0316:m365

Conversation

@wjyao0316

Copy link
Copy Markdown
Contributor

Description

This commit makes two changes.

  1. Change m365 connector default lookback days to 0 per requested. There will be next change to make it configureable soon.

  2. Change number of worker threads based on performance test. During performance test we observe the avg m365 api latency is 235ms. With 7 threads, assuming all threads are busy the TPM would be around 1800 request per minute. It would optimize the throughput while not breach 2000 TPM API limit.

Check List

  • New functionality includes testing.
  • New functionality has a documentation issue. Please link to it in this PR.
    • New functionality has javadoc added
  • Commits are signed with a real name per the DCO

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

This commit makes two changes.

1. Change m365 connector default lookback days to 0 per requested.
There will be next change to make it configureable soon.

2. Change number of worker threads based on performance test. During
performance test we observe the avg m365 api latency is 235ms. With 7
threads, assuming all threads are busy the TPM would be around 1800 request
per minute. It would optimize the throughput while not breach 2000TPM
API limit.

Signed-off-by: Wenjie Yao <wjyao@amazon.com>
@san81 san81 merged commit 1fac7c0 into opensearch-project:main Sep 22, 2025
45 of 47 checks passed
@wjyao0316 wjyao0316 deleted the m365 branch October 23, 2025 04:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants