Search Results for "data replication"
Sort By:
Showing 128 open source projects for "data replication"
View related business solutions-
Next-Gen Encryption for Post-Quantum Security | CLEAR by Quantum KnightCLEAR by Quantum Knight is a FIPS-140-3 validated encryption SDK engineered for enterprises requiring top-tier security. Offering robust post-quantum cryptography, CLEAR secures files, streaming media, databases, and networks with ease across over 30 modern platforms. Its compact design, smaller than a single smartphone image, ensures maximum efficiency and low energy consumption.
-
The full-stack observability platform that protects your dataLayer, tags and conversion dataCode-Cube.io detects issues instantly, alerts you in real time and helps you resolve them fast. No manual QA. No unreliable data. Just data you can trust and act on.
-
1
pg_easy_replicate
Easily setup logical replication and switchover to new database
pg_easy_replicate is a simple tool for replicating PostgreSQL data from one database to another using logical replication. It abstracts away the complexity of publication/subscription setup and enables selective table replication. Ideal for developers or data engineers who want quick replication without deep Postgres expertise. -
2
pglogical
Logical Replication extension for PostgreSQL
pglogical is an advanced logical replication extension for PostgreSQL that allows selective replication of data between databases. Unlike physical replication, it enables fine-grained control of which tables or changes to replicate. It’s well-suited for multi-master setups, version upgrades, and real-time data distribution across environments. -
3
data-diff
Efficiently diff rows across two different databases
...Replicating data at scale, across hundreds of tables, with low latency and at a reasonable infrastructure cost is a hard problem, and most data teams we’ve talked to, have faced data quality issues in their replication processes. The hard truth is that the quality of the replication is the quality of the data. Since copying entire datasets in batch is often infeasible at the modern data scale, businesses rely on the Change Data Capture (CDC) approach of replicating data using a continuous stream of updates. -
4
ReplicaDB
ReplicaDB is open source tool for database replication
ReplicaDB is an open-source, multi-platform tool for database replication, enabling the migration and synchronization of data across different relational and NoSQL databases. It is optimized for efficiency and minimal downtime. -
Simplify Purchasing For Your BusinessSimplify every aspect of buying for your business in Order.co. From sourcing products to scaling purchasing across locations to automating your AP and approvals workstreams, Order.co is the platform of choice for growing businesses.
-
5
SymmetricDS
SymmetricDS is database replication and file synchronization software
SymmetricDS is an open-source platform for database replication and synchronization across heterogeneous systems. It supports multi-master and one-way replication with conflict resolution and works over unreliable networks. SymmetricDS is ideal for distributed applications, data warehousing, and edge deployments where consistency and availability are key. -
6
PeerDB
Fast, Simple and a cost effective tool to replicate data from Postgres
PeerDB is an open-source platform for real-time replication and transformation of data from PostgreSQL to analytical warehouses like BigQuery and Snowflake. It supports Change Data Capture (CDC) and provides seamless syncing and transformation logic with low latency. PeerDB is ideal for teams building real-time data pipelines without relying on expensive proprietary solutions. -
7
SyncLite
Build Anything Sync Anywhere
SyncLite is an open-source, low-code, comprehensive relational data consolidation platform enabling developers to rapidly build data-intensive applications for edge, desktop and mobile environments. SyncLite enables real-time, transactional data replication and consolidation from various sources including edge/desktop applications using popular embedded databases (SQLite, DuckDB, Apache Derby, H2, HyperSQL), data streaming applications, IoT message brokers, traditional database systems(ETL) and more into a diverse array of databases, data warehouses, and data lakes, enabling AI and ML use-cases at all three levels: Edge, Fog and Cloud. ... -
8
Anna’s Archive
Comprehensive search engine for books, papers, comics, magazines
...It relies heavily on technologies such as Elasticsearch for search functionality and MariaDB for structured data storage, enabling fast and efficient querying across massive datasets. The system is designed with redundancy and replication in mind, allowing distributed deployments and mirrored environments to handle high traffic and large data volumes. It also includes tooling for importing datasets, managing metadata, and maintaining structured archives using custom formats. -
9
RxDB
Client side, offline-first, reactive database for JavaScript apps
...Reactive means that you can not only query the current state but subscribe to all state changes like the result of a query or even a single field of a document. This is great for UI-based real-time applications in a way that makes it easy to develop and also has great performance benefits. To replicate data between your clients and server, RxDB provides modules for real-time replication with any CouchDB compliant endpoint and also with custom GraphQL endpoints. Multiplatform support for browsers, nodejs, electron, Cordova, react-native and every other javascript runtime. Replication between client and server-data, compatible with pouchdbPouchDB, couchdbCouchDB, and cloudantIBM Cloudant. ... -
MicroStation by Bentley Systems is the trusted computer-aided design (CAD) software built specifically for infrastructure design.MicroStation is the only computer-aided design software for infrastructure design, helping architects and engineers like you bring their vision to life, present their designs to their clients, and deliver their projects to the community.
-
10
Dgraph
The Only Native GraphQL Database With A Graph Backend
Dgraph is a horizontally scalable and distributed GraphQL database, the only native GraphQL database to have a graph backend. Dgraph is able to do things that other graph DBs can’t. It provides consistent replication, automatic data movement for shard balancing, distributed ACID transactions, as well as native support for full text search, regular expressions and geo search. If you have over 10 SQL tables interconnected via foreign keys, or sparse data that don’t fit neatly into SQL tables; or if you just want a simple and flexible schema, and prioritize speed and performance at scale, Dgraph is the best choice for you. ... -
11
Kubegres
Kubegres is a Kubernetes operator allowing to deploy clusters
Kubegres is a Kubernetes operator that allows to deployment one or many clusters of PostgreSQL pods with data replication and failover enabled out-of-the-box. It brings simplicity when using PostgreSQL considering how complex managing a stateful-set's life cycle and data replication could be with Kubernetes. Kubegres is fully integrated with Kubernetes' lifecycle as it runs as an operator written in Go. It is minimalist in terms of codebase compared to other open-source Postgres operators. ... -
12
pgwire
PostgreSQL wire protocol implemented as a rust library.
Build a Postgres compatible access layer for your data service. This library implements PostgreSQL Wire Protocol and provides essential APIs to write PostgreSQL-compatible servers and clients. If you are interested in a related topic, you can check project ideas to build on top of this library. -
13
ClickHouse
A fast open-source OLAP database management system
...Apart from its blazing speed, ClickHouse is highly reliable and fault tolerant. It supports multi-master asynchronous replication with the option of being deployed across multiple datacenters. With all nodes equal, there is no single point of failure. Downtime of a single node or even the whole datacenter won't affect the system's availability. ClickHouse also has exceptional hardware efficiency and a host of other features, including a feature-rich SQL database, vectorized query execution, real-time query processing and data ingestion, and more. -
14
ReductStore
The fastest time series object store for Edge AI
History storage and management of images, vibration data, text, labels, and more - all in one place with the highest performance. Merge blob and time series functionalities, reducing the need for multiple databases. Customize real-time data retention policies and replication strategies. Store billions of time-stamped blobs with AI labels and access them with low latency. Outperform other databases with a customized solution for time-series object data. ... -
15
pg_flo
Stream, transform, and route PostgreSQL data in real-time
The easiest way to move and transform data between PostgreSQL databases. -
16
Redis
An in-memory database that persists on disk
Redis is an open-source (BSD licensed), in-memory data structure store, used as a database, cache, and message broker. Redis provides data structures such as strings, hashes, lists, sets, sorted sets with range queries, bitmaps, hyperloglogs, geospatial indexes, and streams. Redis has built-in replication, Lua scripting, LRU eviction, transactions, and different levels of on-disk persistence, and provides high availability via Redis Sentinel and automatic partitioning with Redis Cluster. ... -
17
Olric
Distributed, in-memory key/value store and cache
A lightweight, distributed in-memory data store designed for key-value caching and ephemeral storage. -
18
CouchDB.NET
EF Core-like CouchDB experience for .NET
CouchDB-Net is a .NET client library for Apache CouchDB, providing developers with a simple way to interact with the database using C#. It enables document storage, querying, and replication in .NET applications. -
19
Sequin
Postgres change data capture to streams and queues like Kafka
Sequin is a change data capture (CDC) system that replicates API data to Postgres in real time. It syncs services like Stripe, Salesforce, and GitHub into PostgreSQL tables, enabling developers to query third-party data with standard SQL. Sequin is ideal for building data-driven applications that need immediate visibility into external SaaS platforms. -
20
MusicBrainz Server
Server for the MusicBrainz project (website, API, database tools)
...Internationalization, release group types, tagging, and flexible entity relationships reflect the complexity of music cataloging. As a large-scale open-data service, the server must remain performant under frequent reads, submitted edits, replication traffic, and API clients. -
21
Kraken
P2P Docker registry capable of distributing TBs of data in seconds
...Kraken is capable of distributing Docker images at > 50% of max download the speed limit on every host. Cluster size and image size do not have a significant impact on download speed. Support uploader authentication and data integrity protection through TLS. Other than pluggable storage, Kraken only has an optional dependency on DNS. -
22
Canal
MySQL binlog
Canal is an open-source project developed by Alibaba that simulates MySQL slave functionality to parse MySQL binlog files. It enables real-time data synchronization and change data capture (CDC) between MySQL and other systems such as Elasticsearch, Kafka, or HBase. Canal is widely used for data integration, replication, and monitoring across distributed systems, offering high performance and low-latency log parsing. -
23
Sanoid
These are policy-driven snapshot management and replication tools
...It sets and respects ZFS properties, places holds to protect in-use snapshots, and surfaces health issues so you notice problems before recovery time. Paired with its sibling syncoid, it also handles local and remote replication of incremental snapshots over SSH, supporting resume tokens, bandwidth shaping, and common accelerators like mbuffer. The design favors safety and observability: dry-run modes, verbose logging, and conservative defaults reduce the risk of accidental data loss. In production, Sanoid turns ZFS’s powerful but low-level primitives into dependable, auditable data protection for everything from home labs to multi-tenant servers. -
24
pg_auto_failover
Postgres extension and service for automated failover
pg_auto_failover is a PostgreSQL extension and management tool for automated high availability. It handles health checks, failover, and monitoring without requiring third-party tools or complex configuration. Designed by the Citus Data team at Microsoft, it's ideal for developers and ops teams wanting reliable HA with minimal effort. -
25
Zeebe
Distributed Workflow Engine for Microservices Orchestration
...Zeebe’s cloud-native design provides the performance, resilience, and security enterprises need to future-proof their process orchestration efforts. Zeebe distributes data across all brokers in a cluster with storage directly on the server filesystem. If one broker goes down, another can replace it with no data loss. This pre-configured replication mechanism ensures that Camunda Platform 8 can recover from machine or software failure with no human interaction, no data loss and minimal downtime.
