Alternatives to DMSFACTORY DocumentsPipeliner

Compare DMSFACTORY DocumentsPipeliner alternatives for your business or organization using the curated list below. SourceForge ranks the best alternatives to DMSFACTORY DocumentsPipeliner in 2026. Compare features, ratings, user reviews, pricing, and more from DMSFACTORY DocumentsPipeliner competitors and alternatives in order to make an informed decision for your business.

  • 1
    dbt

    dbt

    dbt Labs

    dbt helps data teams transform raw data into trusted, analysis-ready datasets faster. With dbt, data analysts and data engineers can collaborate on version-controlled SQL models, enforce testing and documentation standards, lean on detailed metadata to troubleshoot and optimize pipelines, and deploy transformations reliably at scale. Built on modern software engineering best practices, dbt brings transparency and governance to every step of the data transformation workflow. Thousands of companies, from startups to Fortune 500 enterprises, rely on dbt to improve data quality and trust as well as drive efficiencies and reduce costs as they deliver AI-ready data across their organization. Whether you’re scaling data operations or just getting started, dbt empowers your team to move from raw data to actionable analytics with confidence.
    Compare vs. DMSFACTORY DocumentsPipeliner View Software
    Visit Website
  • 2
    Cribl Stream
    Cribl Stream allows you to implement an observability pipeline which helps you parse, restructure, and enrich data in flight - before you pay to analyze it. Get the right data, where you want, in the formats you need. Route data to the best tool for the job - or all the tools for the job - by translating and formatting data into any tooling schema you require. Let different departments choose different analytics environments without having to deploy new agents or forwarders. As much as 50% of log and metric data goes unused – null fields, duplicate data, and fields that offer zero analytical value. With Cribl Stream, you can trim wasted data streams and analyze only what you need. Cribl Stream is the best way to get multiple data formats into the tools you trust for your Security and IT efforts. Use the Cribl Stream universal receiver to collect from any machine data source - and even to schedule batch collection from REST APIs, Kinesis Firehose, Raw HTTP, and Microsoft Office 365 APIs
  • 3
    DataBahn

    DataBahn

    DataBahn

    DataBahn.ai is redefining how enterprises manage the explosion of security and operational data in the AI era. Our AI-powered data pipeline and fabric platform helps organizations securely collect, enrich, orchestrate, and optimize enterprise data—including security, application, observability, and IoT/OT telemetry—for analytics, automation, and AI. With native support for over 400 integrations and built-in enrichment capabilities, DataBahn streamlines fragmented data workflows and reduces SIEM and infrastructure costs from day one. The platform requires no specialist training, enabling security and IT teams to extract insights in real time and adapt quickly to new demands. We've helped Fortune 500 and Global 2000 companies reduce data processing costs by over 50% and automate more than 80% of their data engineering workloads.
  • 4
    Tenzir

    Tenzir

    Tenzir

    ​Tenzir is a data pipeline engine specifically designed for security teams, facilitating the collection, transformation, enrichment, and routing of security data throughout its lifecycle. It enables users to seamlessly gather data from various sources, parse unstructured data into structured formats, and transform it as needed. It optimizes data volume, reduces costs, and supports mapping to standardized schemas like OCSF, ASIM, and ECS. Tenzir ensures compliance through data anonymization features and enriches data by adding context from threats, assets, and vulnerabilities. It supports real-time detection and stores data efficiently in Parquet format within object storage systems. Users can rapidly search and materialize necessary data and reactivate at-rest data back into motion. Tension is built for flexibility, allowing deployment as code and integration into existing workflows, ultimately aiming to reduce SIEM costs and provide full control.
  • 5
    ABBYY FlexiCapture
    Transforming business documents into business value. Remove friction from document-intensive processes. ABBYY FlexiCapture is an Intelligent Document Processing platform built for the needs of today’s complex digital enterprise. FlexiCapture brings together the best NLP, machine learning, and advanced recognition capabilities into a single, enterprise-scale platform to handle every type of document, from simple forms to complex free-form documents, and every job size, from ad hoc single documents to large batch jobs requiring tough SLAs. Orchestrating the process from acquisition to delivery, FlexiCapture feeds content-driven business applications such as RPA and BPM, helping organizations focus on customer service, cost reduction, compliance, and competitive advantage. More companies are saving millions of dollars by turning to Intelligent Process Automation to identify opportunities for automation and work smarter and faster.
    Starting Price: $169 one-time payment
  • 6
    Dataform

    Dataform

    Google

    Dataform enables data analysts and data engineers to develop and operationalize scalable data transformation pipelines in BigQuery using only SQL from a single, unified environment. Its open source core language lets teams define table schemas, configure dependencies, add column descriptions, and set up data quality assertions within a shared code repository while applying software development best practices, version control, environments, testing, and documentation. A fully managed, serverless orchestration layer automatically handles workflow dependencies, tracks lineage, and executes SQL pipelines on demand or via schedules in Cloud Composer, Workflows, BigQuery Studio, or third-party services. In the browser-based development interface, users get real-time error feedback, visualize dependency graphs, connect to GitHub or GitLab for commits and code reviews, and launch production-grade pipelines in minutes without leaving BigQuery Studio.
  • 7
    RudderStack

    RudderStack

    RudderStack

    RudderStack is the smart customer data pipeline. Easily build pipelines connecting your whole customer data stack, then make them smarter by pulling analysis from your data warehouse to trigger enrichment and activation in customer tools for identity stitching and other advanced use cases. Start building smarter customer data pipelines today.
  • 8
    Spring Cloud Data Flow
    Microservice-based streaming and batch data processing for Cloud Foundry and Kubernetes. Spring Cloud Data Flow provides tools to create complex topologies for streaming and batch data pipelines. The data pipelines consist of Spring Boot apps, built using the Spring Cloud Stream or Spring Cloud Task microservice frameworks. Spring Cloud Data Flow supports a range of data processing use cases, from ETL to import/export, event streaming, and predictive analytics. The Spring Cloud Data Flow server uses Spring Cloud Deployer, to deploy data pipelines made of Spring Cloud Stream or Spring Cloud Task applications onto modern platforms such as Cloud Foundry and Kubernetes. A selection of pre-built stream and task/batch starter apps for various data integration and processing scenarios facilitate learning and experimentation. Custom stream and task applications, targeting different middleware or data services, can be built using the familiar Spring Boot style programming model.
  • 9
    tap

    tap

    Digital Society

    Turn spreadsheets and data files into production-ready APIs without writing backend code. Upload CSV, JSONL, Parquet and other formats, clean and join them with familiar SQL, and expose secure, documented endpoints instantly. Built-in features include auto-generated OpenAPI docs, API key security, geospatial filters with H3 indexing, usage monitoring, and high-performance queries. You can also download transformed datasets anytime to avoid vendor lock-in. Works for single files, combined datasets, or public data portals with minimal setup. Key features - Create secure, documented APIs directly from CSV, JSONL, and Parquet. - Run familiar SQL queries to clean, join, and enrich data. - No backend setup or servers to configure or maintain. - Auto-generated OpenAPI documentation for every endpoint you create. - Secure endpoints with API keys and isolated storage for safety. - Geospatial filters, H3 indexing, and fast, optimised queries at scale.
  • 10
    Talend Pipeline Designer
    Talend Pipeline Designer is a web-based self-service application that takes raw data and makes it analytics-ready. Compose reusable pipelines to extract, improve, and transform data from almost any source, then pass it to your choice of data warehouse destinations, where it can serve as the basis for the dashboards that power your business insights. Build and deploy data pipelines in less time. Design and preview, in batch or streaming, directly in your web browser with an easy, visual UI. Scale with native support for the latest hybrid and multi-cloud technologies, and improve productivity with real-time development and debugging. Live preview lets you instantly and visually diagnose issues with your data. Make better decisions faster with dataset documentation, quality proofing, and promotion. Transform data and improve data quality with built-in functions applied across batch or streaming pipelines, turning data health into an effortless, automated discipline.
  • 11
    Yandex Data Proc
    You select the size of the cluster, node capacity, and a set of services, and Yandex Data Proc automatically creates and configures Spark and Hadoop clusters and other components. Collaborate by using Zeppelin notebooks and other web apps via a UI proxy. You get full control of your cluster with root permissions for each VM. Install your own applications and libraries on running clusters without having to restart them. Yandex Data Proc uses instance groups to automatically increase or decrease computing resources of compute subclusters based on CPU usage indicators. Data Proc allows you to create managed Hive clusters, which can reduce the probability of failures and losses caused by metadata unavailability. Save time on building ETL pipelines and pipelines for training and developing models, as well as describing other iterative tasks. The Data Proc operator is already built into Apache Airflow.
  • 12
    Adele

    Adele

    Adastra

    Adele is an intuitive platform designed to simplify the migration of data pipelines from any legacy system to a target platform. It empowers users with full control over the functional migration process, while its intelligent mapping capabilities offer valuable insights. By reverse-engineering data pipelines, Adele creates data lineage mappings and extracts metadata, enhancing visibility and understanding of data flows.
  • 13
    definity

    definity

    definity

    Monitor and control everything your data pipelines do with zero code changes. Monitor data and pipelines in motion to proactively prevent downtime and quickly root cause issues. Optimize pipeline runs and job performance to save costs and keep SLAs. Accelerate code deployments and platform upgrades while maintaining reliability and performance. Data & performance checks in line with pipeline runs. Checks on input data, before pipelines even run. Automatic preemption of runs. definity takes away the effort to build deep end-to-end coverage, so you are protected at every step, across every dimension. definity shifts observability to post-production to achieve ubiquity, increase coverage, and reduce manual effort. definity agents automatically run with every pipeline, with zero footprints. Unified view of data, pipelines, infra, lineage, and code for every data asset. Detect in run-time and avoid async checks. Auto-preempt runs, even on inputs.
  • 14
    Stripe Data Pipeline
    Stripe Data Pipeline sends all your up-to-date Stripe data and reports to Snowflake or Amazon Redshift in a few clicks. Centralize your Stripe data with other business data to close your books faster and unlock richer business insights. Set up Stripe Data Pipeline in minutes and automatically receive your Stripe data and reports in your data warehouse on an ongoing basis–no code required. Create a single source of truth to speed up your financial close and access better insights. Identify your best-performing payment methods, analyze fraud by location, and more. Send your Stripe data directly to your data warehouse without involving a third-party extract, transform, and load (ETL) pipeline. Offload ongoing maintenance with a pipeline that’s built into Stripe. No matter how much data you have, your data is always complete and accurate. Automate data delivery at scale, minimize security risks, and avoid data outages and delays.
    Starting Price: 3¢ per transaction
  • 15
    Axoflow

    Axoflow

    Axoflow

    Axoflow, the Security Data Layer is the foundation for your SIEM and analytics tools enabling the use of AI, up to 70% faster investigations, and more than 50% reduction in SIEM spend by feeding them with actionable data. Axoflow Platform is built up of the following parts: A pipeline acting as the transportation layer for your security data and also acting as an automated ‘translator’ between data schemas. AI - If you prefer to run your detection content locally - whether it’s an AI or ML model, a threat intel lookup, or another type of enrichment - we’ve got you covered. Storage solutions to facilitate the cost-effective storage of security data and also acting as local storage to run your decentralized detection. Orchestration to weave all of the parts together in an easy-to-use GUI that lets youmonitor and manage, and control and search your data.
  • 16
    Upsolver

    Upsolver

    Upsolver

    Upsolver makes it incredibly simple to build a governed data lake and to manage, integrate and prepare streaming data for analysis. Define pipelines using only SQL on auto-generated schema-on-read. Easy visual IDE to accelerate building pipelines. Add Upserts and Deletes to data lake tables. Blend streaming and large-scale batch data. Automated schema evolution and reprocessing from previous state. Automatic orchestration of pipelines (no DAGs). Fully-managed execution at scale. Strong consistency guarantee over object storage. Near-zero maintenance overhead for analytics-ready data. Built-in hygiene for data lake tables including columnar formats, partitioning, compaction and vacuuming. 100,000 events per second (billions daily) at low cost. Continuous lock-free compaction to avoid “small files” problem. Parquet-based tables for fast queries.
  • 17
    Datazoom

    Datazoom

    Datazoom

    Improving the experience, efficiency, and profitability of streaming video requires data. Datazoom enables video publishers to better operate distributed architectures through centralizing, standardizing, and integrating data in real-time to create a more powerful data pipeline and improve observability, adaptability, and optimization solutions. Datazoom is a video data platform that continually gathers data from endpoints, like a CDN or a video player, through an ecosystem of collectors. Once the data is gathered, it is normalized using standardized data definitions. This data is then sent through available connectors to analytics platforms like Google BigQuery, Google Analytics, and Splunk and can be visualized in tools such as Looker and Superset. Datazoom is your key to a more effective and efficient data pipeline. Get the data you need in real-time. Don’t wait for your data when you need to resolve an issue immediately.
  • 18
    Datavolo

    Datavolo

    Datavolo

    Capture all your unstructured data for all your LLM needs. Datavolo replaces single-use, point-to-point code with fast, flexible, reusable pipelines, freeing you to focus on what matters most, doing incredible work. Datavolo is the dataflow infrastructure that gives you a competitive edge. Get fast, unencumbered access to all of your data, including the unstructured files that LLMs rely on, and power up your generative AI. Get pipelines that grow with you, in minutes, not days, without custom coding. Instantly configure from any source to any destination at any time. Trust your data because lineage is built into every
pipeline. Make single-use pipelines and expensive configurations a thing of the past. Harness your unstructured data and unleash AI innovation with Datavolo, powered by Apache NiFi and built specifically for unstructured data. Our founders have spent a lifetime helping organizations make the most of their data.
  • 19
    Crux

    Crux

    Crux

    Find out why the heavy hitters are using the Crux external data automation platform to scale external data integration, transformation, and observability without increasing headcount. Our cloud-native data integration technology accelerates the ingestion, preparation, observability and ongoing delivery of any external dataset. The result is that we can ensure you get quality data in the right place, in the right format when you need it. Leverage automatic schema detection, delivery schedule inference, and lifecycle management to build pipelines from any external data source quickly. Enhance discoverability throughout your organization through a private catalog of linked and matched data products. Enrich, validate, and transform any dataset to quickly combine it with other data sources and accelerate analytics.
  • 20
    OpenSnowcat

    OpenSnowcat

    OpenSnowcat

    OpenSnowcat is an open source fork of Snowplow under the Apache 2.0 License that delivers a full event data pipeline for collection, enrichment, routing, and loading, remaining fully compatible with Snowplow and Segment SDKs. It provides an end-to-end solution to collect behavioral data from web and mobile sources, enrich it with customizable processes, route events through modern integrations, and load enriched data into destinations such as Snowflake, Redshift, S3, Amplitude, Kinesis, and more, with support for JSON and TSV output formats. OpenSnowcat emphasizes being free and open source forever with a trusted license, aiming for security, stability, and backward compatibility so existing Snowplow implementations can continue without disruption. Its architecture is designed for high performance, minimal latency, and dynamic scalability, integrating with cloud services to simplify management and cost efficiency at scale.
  • 21
    Dagster

    Dagster

    Dagster Labs

    Dagster is a next-generation orchestration platform for the development, production, and observation of data assets. Unlike other data orchestration solutions, Dagster provides you with an end-to-end development lifecycle. Dagster gives you control over your disparate data tools and empowers you to build, test, deploy, run, and iterate on your data pipelines. It makes you and your data teams more productive, your operations more robust, and puts you in complete control of your data processes as you scale. Dagster brings a declarative approach to the engineering of data pipelines. Your team defines the data assets required, quickly assessing their status and resolving any discrepancies. An assets-based model is clearer than a tasks-based one and becomes a unifying abstraction across the whole workflow.
  • 22
    Catalog

    Catalog

    Coalesce

    Catalog from Coalesce (formerly CastorDoc) is a data catalog designed for mass adoption across the whole company. Have an overview of all your data environment. Search for data instantly thanks to our powerful search engine. Onboard to a new data infrastructure and access data in a breeze. Go beyond your traditional data catalog. Modern data teams now have numerous data sources, build one truth. With its delightful and automated documentation experience, Catalog makes it dead simple to trust data. Column-level, cross-system data lineage in minutes. Get a bird’s eye view of your data pipelines to build trust in your data. Troubleshoot data issues, perform impact analyses, comply with GDPR in one tool. Optimize performance, cost, compliance, and security for your data. Keep your data stack healthy with our automated infrastructure monitoring system.
  • 23
    Openbridge

    Openbridge

    Openbridge

    Uncover insights to supercharge sales growth using code-free, fully-automated data pipelines to data lakes or cloud warehouses. A flexible, standards-based platform to unify sales and marketing data for automating insights and smarter growth. Say goodbye to messy, expensive manual data downloads. Always know what you’ll pay and only pay for what you use. Fuel your tools with quick access to analytics-ready data. As certified developers, we only work with secure, official APIs. Get started quickly with data pipelines from popular sources. Pre-built, pre-transformed, and ready-to-go data pipelines. Unlock data from Amazon Vendor Central, Amazon Seller Central, Instagram Stories, Facebook, Amazon Advertising, Google Ads, and many others. Code-free data ingestion and transformation processes allow teams to realize value from their data quickly and cost-effectively. Data is always securely stored directly in a trusted, customer-owned data destination like Databricks, Amazon Redshift, etc.
  • 24
    Datastreamer

    Datastreamer

    Datastreamer

    Integrate unstructured external data into your organization in minutes. Datastreamer is a turnkey data platform to source, unify, and enrich unstructured external data with 95% less work than building pipelines in-house. Customers use Datastreamer to feed specialized AI models and accelerate insights in Threat Intelligence, KYC/AML, Financial Analysis and more. Feed your analytics products or specialized AI models with billions of data pieces from social media, blogs, news, forums, dark web data, and more. Our platform unifies source data into a common schema so you can use content from multiple sources simultaneously. Leverage our pre-integrated data partners or connect data from any data supplier. Tap into our powerful AI models to enhance data with components like sentiment analysis and PII redaction. Scale data pipelines with less costs by plugging into our managed infrastructure that is optimized to handle massive volumes of text data.
  • 25
    Alooma

    Alooma

    Google

    Alooma enables data teams to have visibility and control. It brings data from your various data silos together into BigQuery, all in real time. Set up and flow data in minutes or customize, enrich, and transform data on the stream before it even hits the data warehouse. Never lose an event. Alooma's built in safety nets ensure easy error handling without pausing your pipeline. Any number of data sources, from low to high volume, Alooma’s infrastructure scales to your needs.
  • 26
    Osmos

    Osmos

    Osmos

    With Osmos, your customers can easily clean their messy data files and import them directly into your operational system without writing a line of code. At the core, we have an AI-powered data transformation engine that enables users to map, validate, and clean data with only a few clicks. Your account will be charged or credited based on the percentage of the billing cycle left at the time the plan was changed. An eCommerce company automates ingestion of product catalog data from multiple distributors and vendors into their database. A manufacturing company automates the data ingestion of purchase orders from email attachments into Netsuite. Automatically clean up and reformat incoming data to match your destination schema. Never deal with custom scripts and spreadsheets again.
  • 27
    QuickLaunch Analytics

    QuickLaunch Analytics

    QuickLaunch Analytics

    QuickLaunch Analytics is an enterprise data analytics platform that helps organizations turn fragmented data from ERP, CRM, financial, HR and operational systems into a unified, governed analytics ecosystem with faster, business-ready insights; rather than building analytics infrastructure from scratch, it provides a Foundation Pack that includes automated data pipelines, a cloud-native data lakehouse and Power BI semantic models so raw enterprise data can be integrated, cleaned, and governed for analytics, and Application Packs that layer pre-built, application-specific intelligence and production-ready semantic models tailored to systems like JD Edwards, Viewpoint Vista, NetSuite, Salesforce and others to decode complex data structures into business-friendly metrics and dashboards; the platform accelerates time-to-insight from months/years to weeks with standardized metrics and reports, supports cross-application analysis and self-service BI, and uses modern technologies.
  • 28
    Pantomath

    Pantomath

    Pantomath

    Organizations continuously strive to be more data-driven, building dashboards, analytics, and data pipelines across the modern data stack. Unfortunately, most organizations struggle with data reliability issues leading to poor business decisions and lack of trust in data as an organization, directly impacting their bottom line. Resolving complex data issues is a manual and time-consuming process involving multiple teams all relying on tribal knowledge to manually reverse engineer complex data pipelines across different platforms to identify root-cause and understand the impact. Pantomath is a data pipeline observability and traceability platform for automating data operations. It continuously monitors datasets and jobs across the enterprise data ecosystem providing context to complex data pipelines by creating automated cross-platform technical pipeline lineage.
  • 29
    IBM StreamSets
    IBM® StreamSets enables users to create and manage smart streaming data pipelines through an intuitive graphical interface, facilitating seamless data integration across hybrid and multicloud environments. This is why leading global companies rely on IBM StreamSets to support millions of data pipelines for modern analytics, intelligent applications and hybrid integration. Decrease data staleness and enable real-time data at scale—handling millions of records of data, across thousands of pipelines within seconds. Insulate data pipelines from change and unexpected shifts with drag-and-drop, prebuilt processors designed to automatically identify and adapt to data drift. Create streaming pipelines to ingest structured, semistructured or unstructured data and deliver it to a wide range of destinations.
  • 30
    Orchestra

    Orchestra

    Orchestra

    Orchestra is a Unified Control Plane for Data and AI Operations, designed to help data teams build, deploy, and monitor workflows with ease. It offers a declarative framework that combines code and GUI, allowing users to implement workflows 10x faster and reduce maintenance time by 50%. With real-time metadata aggregation, Orchestra provides full-stack data observability, enabling proactive alerting and rapid recovery from pipeline failures. It integrates seamlessly with tools like dbt Core, dbt Cloud, Coalesce, Airbyte, Fivetran, Snowflake, BigQuery, Databricks, and more, ensuring compatibility with existing data stacks. Orchestra's modular architecture supports AWS, Azure, and GCP, making it a versatile solution for enterprises and scale-ups aiming to streamline their data operations and build trust in their AI initiatives.
  • 31
    Kestra

    Kestra

    Kestra

    Kestra is an open-source, event-driven orchestrator that simplifies data operations and improves collaboration between engineers and business users. By bringing Infrastructure as Code best practices to data pipelines, Kestra allows you to build reliable workflows and manage them with confidence. Thanks to the declarative YAML interface for defining orchestration logic, everyone who benefits from analytics can participate in the data pipeline creation process. The UI automatically adjusts the YAML definition any time you make changes to a workflow from the UI or via an API call. Therefore, the orchestration logic is defined declaratively in code, even if some workflow components are modified in other ways.
  • 32
    Informatica Data Engineering
    Ingest, prepare, and process data pipelines at scale for AI and analytics in the cloud. Informatica’s comprehensive data engineering portfolio provides everything you need to process and prepare big data engineering workloads to fuel AI and analytics: robust data integration, data quality, streaming, masking, and data preparation capabilities. Rapidly build intelligent data pipelines with CLAIRE®-powered automation, including automatic change data capture (CDC) Ingest thousands of databases and millions of files, and streaming events. Accelerate time-to-value ROI with self-service access to trusted, high-quality data. Get unbiased, real-world insights on Informatica data engineering solutions from peers you trust. Reference architectures for sustainable data engineering solutions. AI-powered data engineering in the cloud delivers the trusted, high quality data your analysts and data scientists need to transform business.
  • 33
    GlassFlow

    GlassFlow

    GlassFlow

    GlassFlow is a serverless, event-driven data pipeline platform designed for Python developers. It enables users to build real-time data pipelines without the need for complex infrastructure like Kafka or Flink. By writing Python functions, developers can define data transformations, and GlassFlow manages the underlying infrastructure, offering auto-scaling, low latency, and optimal data retention. The platform supports integration with various data sources and destinations, including Google Pub/Sub, AWS Kinesis, and OpenAI, through its Python SDK and managed connectors. GlassFlow provides a low-code interface for quick pipeline setup, allowing users to create and deploy pipelines within minutes. It also offers features such as serverless function execution, real-time API connections, and alerting and reprocessing capabilities. The platform is designed to simplify the creation and management of event-driven data pipelines, making it accessible for Python developers.
  • 34
    Nextflow

    Nextflow

    Seqera Labs

    Data-driven computational pipelines. Nextflow enables scalable and reproducible scientific workflows using software containers. It allows the adaptation of pipelines written in the most common scripting languages. Its fluent DSL simplifies the implementation and deployment of complex parallel and reactive workflows on clouds and clusters. Nextflow is built around the idea that Linux is the lingua franca of data science. Nextflow allows you to write a computational pipeline by making it simpler to put together many different tasks. You may reuse your existing scripts and tools and you don't need to learn a new language or API to start using it. Nextflow supports Docker and Singularity containers technology. This, along with the integration of the GitHub code-sharing platform, allows you to write self-contained pipelines, manage versions, and rapidly reproduce any former configuration. Nextflow provides an abstraction layer between your pipeline's logic and the execution layer.
  • 35
    Prefect

    Prefect

    Prefect

    Prefect is a workflow orchestration and automation platform designed for the modern context-driven era. It enables teams to turn Python functions into production-ready workflows with minimal effort. Prefect provides open-source foundations alongside managed platforms for enterprise-scale automation. The platform supports building and orchestrating data pipelines, workflows, and AI applications with full observability. Prefect Cloud offers managed orchestration with autoscaling, enterprise authentication, and built-in governance. Prefect Horizon extends automation to AI infrastructure by enabling deployment of MCP servers for AI agents. Trusted by leading organizations, Prefect helps teams scale automation without operational complexity.
  • 36
    Oarkflow

    Oarkflow

    Oarkflow

    Automate your business pipeline with our flow builder. Use operations that matters to you. Bring your own service providers for email, sms and http services. Use our advanced query builder to query and analyze csv with any field numbers and rows. We store the csv files you've uploaded on our platform in a secured vault and account activity logs. We don't store any data records you request for processing.
  • 37
    Apache Airflow

    Apache Airflow

    The Apache Software Foundation

    Airflow is a platform created by the community to programmatically author, schedule and monitor workflows. Airflow has a modular architecture and uses a message queue to orchestrate an arbitrary number of workers. Airflow is ready to scale to infinity. Airflow pipelines are defined in Python, allowing for dynamic pipeline generation. This allows for writing code that instantiates pipelines dynamically. Easily define your own operators and extend libraries to fit the level of abstraction that suits your environment. Airflow pipelines are lean and explicit. Parametrization is built into its core using the powerful Jinja templating engine. No more command-line or XML black-magic! Use standard Python features to create your workflows, including date time formats for scheduling and loops to dynamically generate tasks. This allows you to maintain full flexibility when building your workflows.
  • 38
    VirtualMetric

    VirtualMetric

    VirtualMetric

    VirtualMetric is a powerful telemetry pipeline solution designed to enhance data collection, processing, and security monitoring across enterprise environments. Its core offering, DataStream, automatically collects and transforms security logs from a wide range of systems such as Windows, Linux, MacOS, and Unix, enriching data for further analysis. By reducing data volume and filtering out non-meaningful logs, VirtualMetric helps businesses lower SIEM ingestion costs, increase operational efficiency, and improve threat detection accuracy. The platform’s scalable architecture, with features like zero data loss and long-term compliance storage, ensures that businesses can maintain high security standards while optimizing performance.
  • 39
    BigBI

    BigBI

    BigBI

    BigBI enables data specialists to build their own powerful big data pipelines interactively & efficiently, without any coding! BigBI unleashes the power of Apache Spark enabling: Scalable processing of real Big Data (up to 100X faster) Integration of traditional data (SQL, batch files) with modern data sources including semi-structured (JSON, NoSQL DBs, Elastic, Hadoop), and unstructured (Text, Audio, video), Integration of streaming data, cloud data, AI/ML & graphs
  • 40
    SysTools Office 365 Backup & Restore
    Best Rated Solution by Office 365 administrators to backup Office 365 data and restore mailbox from Office 365 backup. Use SysTools Office 365 Cloud Backup & Restore tool to protect data from external threats by backing up sensitive Office 365 emails, calendars, and contacts in an offline environment. This software provides users an inbuilt dashboard that allows them to track the real-time progress of the O365 mailboxes. The tool offers two views in which they can monitor the progress. Save email messages from Inbox, Outbox, sent items, deleted items, drafts, and junk email folders with complete meta-data properties. Backup all types of attachments, including cloud attachments whether in the form of documents or images. With the tool, it is smooth to save only a copy of a particular range of emails on the specified location. Restore messages with attachment file along with complete metadata attributes and folder structure.
  • 41
    AWS Data Pipeline
    AWS Data Pipeline is a web service that helps you reliably process and move data between different AWS compute and storage services, as well as on-premises data sources, at specified intervals. With AWS Data Pipeline, you can regularly access your data where it’s stored, transform and process it at scale, and efficiently transfer the results to AWS services such as Amazon S3, Amazon RDS, Amazon DynamoDB, and Amazon EMR. AWS Data Pipeline helps you easily create complex data processing workloads that are fault tolerant, repeatable, and highly available. You don’t have to worry about ensuring resource availability, managing inter-task dependencies, retrying transient failures or timeouts in individual tasks, or creating a failure notification system. AWS Data Pipeline also allows you to move and process data that was previously locked up in on-premises data silos.
  • 42
    Onum

    Onum

    Onum

    ​Onum is a real-time data intelligence platform that empowers security and IT teams to derive actionable insights from data in-stream, facilitating rapid decision-making and operational efficiency. By processing data at the source, Onum enables decisions in milliseconds, not minutes, simplifying complex workflows and reducing costs. It offers data reduction capabilities, intelligently filtering and reducing data at the source to ensure only valuable information reaches analytics platforms, thereby minimizing storage requirements and associated costs. It also provides data enrichment features, transforming raw data into actionable intelligence by adding context and correlations in real time. Onum simplifies data pipeline management through efficient data routing, ensuring the right data is delivered to the appropriate destinations instantly, supporting various sources and destinations.
  • 43
    Tarsal

    Tarsal

    Tarsal

    Tarsal's infinite scalability means as your organization grows, Tarsal grows with you. Tarsal makes it easy for you to switch where you're sending data - today's SIEM data is tomorrow's data lake data; all with one click. Keep your SIEM and gradually migrate analytics over to a data lake. You don't have to rip anything out to use Tarsal. Some analytics just won't run on your SIEM. Use Tarsal to have query-ready data on a data lake. Your SIEM is one of the biggest line items in your budget. Use Tarsal to send some of that data to your data lake. Tarsal is the first highly scalable ETL data pipeline built for security teams. Easily exfil terabytes of data in just just a few clicks, with instant normalization, and route that data to your desired destination.
  • 44
    Data Taps

    Data Taps

    Data Taps

    Build your data pipelines like Lego blocks with Data Taps. Add new metrics layers, zoom in, and investigate with real-time streaming SQL. Build with others, share and consume data, globally. Refine and update without hassle. Use multiple models/schemas during schema evolution. Built to scale with AWS Lambda and S3.
  • 45
    Azure Event Hubs
    Event Hubs is a fully managed, real-time data ingestion service that’s simple, trusted, and scalable. Stream millions of events per second from any source to build dynamic data pipelines and immediately respond to business challenges. Keep processing data during emergencies using the geo-disaster recovery and geo-replication features. Integrate seamlessly with other Azure services to unlock valuable insights. Allow existing Apache Kafka clients and applications to talk to Event Hubs without any code changes—you get a managed Kafka experience without having to manage your own clusters. Experience real-time data ingestion and microbatching on the same stream. Focus on drawing insights from your data instead of managing infrastructure. Build real-time big data pipelines and respond to business challenges right away.
  • 46
    BDB Platform

    BDB Platform

    Big Data BizViz

    BDB is a modern data analytics and BI platform which can skillfully dive deep into your data to provide actionable insights. It is deployable on the cloud as well as on-premise. Our exclusive microservices based architecture has the elements of Data Preparation, Predictive, Pipeline and Dashboard designer to provide customized solutions and scalable analytics to different industries. BDB’s strong NLP based search enables the user to unleash the power of data on desktop, tablets and mobile as well. BDB has various ingrained data connectors, and it can connect to multiple commonly used data sources, applications, third party API’s, IoT, social media, etc. in real-time. It lets you connect to RDBMS, Big data, FTP/ SFTP Server, flat files, web services, etc. and manage structured, semi-structured as well as unstructured data. Start your journey to advanced analytics today.
  • 47
    Lumada IIoT
    Embed sensors for IoT use cases and enrich sensor data with control system and environment data. Integrate this in real time with enterprise data and deploy predictive algorithms to discover new insights and harvest your data for meaningful use. Use analytics to predict maintenance problems, understand asset utilization, reduce defects and optimize processes. Harness the power of connected devices to deliver remote monitoring and diagnostics services. Employ IoT Analytics to predict safety hazards and comply with regulations to reduce worksite accidents. Lumada Data Integration: Rapidly build and deploy data pipelines at scale. Integrate data from lakes, warehouses and devices, and orchestrate data flows across all environments. By building ecosystems with customers and business partners in various business areas, we can accelerate digital innovation to create new value for a new society.
  • 48
    Observo AI

    Observo AI

    Observo AI

    ​Observo AI is an AI-native data pipeline platform designed to address the challenges of managing vast amounts of telemetry data in security and DevOps operations. By leveraging machine learning and agentic AI, Observo AI automates data optimization, enabling enterprises to process AI-generated data more efficiently, securely, and cost-effectively. It reduces data processing costs by over 50% and accelerates incident response times by more than 40%. Observo AI's features include intelligent data deduplication and compression, real-time anomaly detection, and dynamic data routing to appropriate storage or analysis tools. It also enriches data streams with contextual information to enhance threat detection accuracy while minimizing false positives. Observo AI offers a searchable cloud data lake for efficient data storage and retrieval.
  • 49
    Actifio

    Actifio

    Google

    Automate self-service provisioning and refresh of enterprise workloads, integrate with existing toolchain. High-performance data delivery and re-use for data scientists through a rich set of APIs and automation. Recover any data across any cloud from any point in time – at the same time – at scale, beyond legacy solutions. Minimize the business impact of ransomware / cyber attacks by recovering quickly with immutable backups. Unified platform to better protect, secure, retain, govern, or recover your data on-premises or in the cloud. Actifio’s patented software platform turns data silos into data pipelines. Virtual Data Pipeline (VDP) delivers full-stack data management — on-premises, hybrid or multi-cloud – from rich application integration, SLA-based orchestration, flexible data movement, and data immutability and security.
  • 50
    DataKitchen

    DataKitchen

    DataKitchen

    Reclaim control of your data pipelines and deliver value instantly, without errors. The DataKitchen™ DataOps platform automates and coordinates all the people, tools, and environments in your entire data analytics organization – everything from orchestration, testing, and monitoring to development and deployment. You’ve already got the tools you need. Our platform automatically orchestrates your end-to-end multi-tool, multi-environment pipelines – from data access to value delivery. Catch embarrassing and costly errors before they reach the end-user by adding any number of automated tests at every node in your development and production pipelines. Spin-up repeatable work environments in minutes to enable teams to make changes and experiment – without breaking production. Fearlessly deploy new features into production with the push of a button. Free your teams from tedious, manual work that impedes innovation.