StreamSets Platform Reviews

Easy to use (for experienced users)FlexibilityEscalabilityCloud NativeMulticloud

It can be really complex to understand for someone not realated to data procesing

The flexibility to deploy on different clouds the same solution

well know AWS-based sources are missed like Sales ads & seller partner

I enjoy the well built user interface and the ability to see the data in flight in the pipeline.

It proved to be very difficult to extend a simple pipeline to accomodate a different scenarios. In addition, common stuff like CDC seemed a bit difficult to set up.

It is very handy to ingest real-time streaming data for processing which can also scale based on the data volume. It can also be integrated with third party provider tools like snowflake, spark etc.. for data transformation.

It might be not useful for a very large real-time streaming data as it might take too much time to handle those data and transform accordingly compare to Cloud Dataflow. And another drawback I would say, it doesn't have detailed documentation.

I not only love how easily configurable are stages of StreamSets but also other functionality provided by StreamSets. i,e SDK. I have mostly worked on SDK part lately. I also liked streamSets provided 3 engine type for use and provided especially different engine for Snowflake. Streamsets provided handy easily configurable connectors for many famous sources and destinations, which mostly worked in favor of ETL developer. Data drift is main feature of Streamsets.

As many connectors are provided, but Streamsets also don.t have connectors for many sources and destination. Also SDK kit doesn't have many things not mentioned in documentation. How to configured stages in SDK? but with small work that can be found.

easy to install and use , deployment pipeline is also not complex you can use docker to install and run as container . interface is user friendly but some time is required to understand the features and how it works . i have been using data collector for ingesting data with jdbc to database . streamsets also provides logs for better monitoring , it provides many stages and libraries with them to ingest data from source to destination.

logging is complex , sometimes preview doesn't work , if you copy and use same pipeline in different server the library dependency create problems .

I have been using DataOps platform since past 6 months and had a very good experience while creating pipelines, jobs, subscriptions and all other things. Moreover the platform is very user friendly.

One thing which I feel can be better is the time required to create a engine and restart the same.

I think the feature that I like is the connectors which included in the platform.

This is not the least but the connectivity between the data container and the control hub is little bit lagging.

GUI Based implementation.Can be used using Python SDK which makes it easy to use.

The functionalities keeps on changing which requires proper documentation to follow.

its ease of use and connectivity to almost all modern platform makes it a wonderful platform

Since its new there are a lot of things to improve. Such as the bugs. Streamsets should release new version more often.

Setting up data pipelines is easy and straight forward, if connectors are available and not much inflight processing has to be done, one get's quick results

More complex usecases or REST endpoints often need workarounds or custom code

Great GUI and monitoring of the data streaming pipeline

- Improve the CDC stage to allow fresh load for a particular table
- Improve error handling messages

The ability to continuously integrate data with a system for alerts to know when things break is a really attractive feature.

The streamsets platform is not the fastest at times, lags or slows down occasionally.

Ability to build pipeline within no time, with so many featurs and configurations available.

It should have third party based processors. it is trying to build all by itself.

The best part of this platform is the drag and drop GUI, it allows someone who has never built a pipeline before to understand ETL faster.

I do not have many cons about this software. I think it allows users to work faster and be more efficient with their time and resources compared to other platforms.

CI/CD with StreamSets is great. Support for multiple data platforms makes it a great choice for data integration

The logging system might be made better. If I work on a pipeline, then make a task from it, and it runs, it will continuously produce logs. Therefore, the logging system might be made simpler. The logs are now a little more challenging to comprehend and filter. It takes a while.