Skip to content

Confluentinc kafka javascript#279

Merged
CarlosGamero merged 18 commits into
mainfrom
feat/confluentinc-kafka-javascript
May 23, 2025
Merged

Confluentinc kafka javascript#279
CarlosGamero merged 18 commits into
mainfrom
feat/confluentinc-kafka-javascript

Conversation

@CarlosGamero

Copy link
Copy Markdown
Collaborator

No description provided.

@CarlosGamero CarlosGamero self-assigned this May 22, 2025
Comment thread docker-compose.yml
Comment on lines +61 to 72
kafka-ui:
container_name: kafka-ui
image: provectuslabs/kafka-ui:latest
ports:
- 8080:8080
depends_on:
- kafka
environment:
DYNAMIC_CONFIG_ENABLED: 'true'
KAFKA_CLUSTERS_0_NAME: Local
KAFKA_CLUSTERS_0_BOOTSTRAPSERVERS: kafka:9093
restart: on-failure

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is useful to debug tests 😅

@CarlosGamero

Copy link
Copy Markdown
Collaborator Author

Kafka CI is failing due to npm install --ignore-scripts, we need to execute scripts for @confluentinc/kafka-javascript, if we decide to go with this library I will address it :D

@CarlosGamero CarlosGamero marked this pull request as ready for review May 22, 2025 17:10
@CarlosGamero CarlosGamero requested review from kibertoad and kjamrog May 22, 2025 17:17
@CarlosGamero CarlosGamero force-pushed the feat/confluentinc-kafka-javascript branch from a7efe67 to f7f3254 Compare May 22, 2025 19:00
@CarlosGamero

Copy link
Copy Markdown
Collaborator Author

We have developed a similar test for the libraries under consideratio, it can be used to get an initial sense of their performance. Please take these numbers with a grain of salt—they do not represent formal benchmarks, and more effort would be required for accurate benchmarking.

Performance results from our preliminary tests:

  • node-rdkafka
    • Test run time: 4s
    • Script build time: 1m 27s
    • Does not support threads
  • confluentinc-kafka
    • Test run time: 3s
    • Script build time: 1s
    • Does not support threads
  • platformatic-kafka
    • Test run time: 3s
    • No script build step required
    • Supports threads

Comment thread packages/kafka/lib/test.spec.ts
Comment thread packages/kafka/lib/test.spec.ts Outdated
Comment thread packages/kafka/package.json Outdated
@CarlosGamero CarlosGamero merged commit 5d05a53 into main May 23, 2025
30 checks passed
@CarlosGamero CarlosGamero deleted the feat/confluentinc-kafka-javascript branch May 23, 2025 13:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants