Data Synchronization over HTTP

Our data format and reference implementation enable asynchronous replication of data across multiple independent systems. Built on HTTP and open web standards, it offers high compatibility and easy integration. The system supports both near real-time and snapshot replication, catering to diverse data synchronization needs. With this solution, data can be efficiently and reliably exchanged between different platforms, unlocking numerous possibilities for distributed and decentralized IT infrastructures.

Quickstart Example

Benefits

Interoperable

Our system utilizes HTTP features like caching, authentication, and compression, supporting both text and binary data. Integrating within your existing HTTP infrastructure, it minimizes the need for additional setup. This simplifies deployment and leverages established web technologies to provide robust, scalable solutions.

Multipurpose

Entity formats enables the combination of different feed and snapshot formats, meeting a wide range of replication requirements. Enables you to handle diverse data synchronization scenarios.

Lightweight

The feed and snapshot message format utilizes the standard HTTP multipart format, supported by HTTP headers to enable navigation between pages. A standardized design simplifies the implementation of your own consumer, or you can use our reference implementation.

Rollback

Our snapshots are fully independent and can be stored in any storage system like a filesystem, S3 or a database, unlike other replication techniques. This allows you to implement your own distribution over HTTP. Rolling back to a previous state is as simple as an HTTP redirect to another snapshot, ensuring an efficient data management process.

How it works

Create Data Exports

Generate complete data exports using snapshots. Each snapshot captures a specific data point on a given date.

Schedule Periodic Updates

Keep consumers up to date by scheduling regular snapshots. This ensures that your data remains up to date and accurate.

snapshot only implementation for consuming complete data exports

Utilize Continuous Data Feeds

Implement continuous data flows for a constant stream of updates. You can start consuming a feed from any available datetime.

Data replication using a feed with a snapshot entry point

Combine Snapshots and Feeds

Integrate snapshots with feeds for efficient data publishing and consumption between (micro)services.

Focus on Recent Changes

For consumers only interested in the latest updates, a feed-only implementation can be used. This allows them to only receive the most recent changes without needing to care about historical data.

feed only implementation for consuming recent data only

is a product of

Legal Notice

About neuland

As a specialist for invididual e-commerce solutions, we analyze your business processes, define goals, find ways and develop the software that makes retailers successful in e-commerce.

www.neuland-bfi.de

neuland – Büro für Informatik GmbH
Konsul-Smidt-Str. 8g (Speicher 1)
D-28217 Bremen
Tel: 04 21. 38 01 07 -0

contact@datareplication.io

Datareplication.io