Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Improvement][datax] Support DataX parameter batchSize for writer #16754

Open
2 of 3 tasks
bromine0x23 opened this issue Oct 31, 2024 · 2 comments
Open
2 of 3 tasks

[Improvement][datax] Support DataX parameter batchSize for writer #16754

bromine0x23 opened this issue Oct 31, 2024 · 2 comments
Labels
good first issue good first issue improvement make more easy to user or prompt friendly

Comments

@bromine0x23
Copy link

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Description

Currently DataX task does not support writer parameter batchSize, therefore only the default values can be used, which is 2048.

However this default value is too small for some databases, such as the ClickHouse I'm using. The example value in DataX is 65536.

So I need the support of batchSize parameter.

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct
@bromine0x23 bromine0x23 added improvement make more easy to user or prompt friendly Waiting for reply Waiting for reply labels Oct 31, 2024
@SbloodyS SbloodyS added good first issue good first issue and removed Waiting for reply Waiting for reply labels Oct 31, 2024
@YOMO-Lee
Copy link

YOMO-Lee commented Nov 2, 2024

i think can try do it

@xinxingi
Copy link
Contributor

xinxingi commented Nov 6, 2024

Using a custom template

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
good first issue good first issue improvement make more easy to user or prompt friendly
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@bromine0x23 @SbloodyS @YOMO-Lee @xinxingi