Home / Services / Big Data Solutions

Big Data Solutions

High-volume database engineering for finance and financial data, with high-performance native functions in C.

Work process

  1. Data analysis
  2. DB design
  3. Implementation
  4. Test run/Verification
  5. Tuning
  6. Operation

Core competencies

Solution
MySQL and MariaDB design, implementation and tuning for real-time transaction systems with high-volume data.
Key elements
  • Millions of records
  • More than 10 million queries per day
  • Finance and financial data refinery into verified, analysis-ready tables
  • MariaDB core defect analysis and fixes, AI-powered
  • Integration of two 24/7 service databases with 30 million user records
  • Unified authentication
  • Row-level comparison against reference data before and after every release
Built for
Finance and financial data platforms, and 24/7 online services with large user databases.
More
  • The two integrated service databases were geographically separated; the integration also reduced remote data retrieval time.

High-performance native functions in C

Solution
User-defined functions in C for MySQL and MariaDB that run finance calculations at native speed.
Key elements
  • Real-time calculation at 3.8 ms per call
  • Data marts of more than 27 million rows
  • Bulk data cleanup: 22.7 million rows in 50 seconds
  • Native x64 libraries
  • Verified against reference implementations
  • Stored procedures and triggers
Built for
Finance and financial data platforms that need real-time calculation on large tables.

Real-time pipelines under concurrent load

Solution
Data pipelines and multi-process data platforms that stay consistent while many processes work on the same database.
Key elements
  • Stored procedure pipelines
  • No lock wait timeouts under concurrent load
  • Transaction data integrity
Built for
Data platforms that run batch and real-time processes against the same database.

Representative solutions

Selected examples of what we build and operate; not a complete list.

In-Memory Transactional Storage Engine

High-performance in-memory transactional storage engine for MySQL and MariaDB, backed by AI-powered fixes of MariaDB core defects.

View details

mediumSQL

High-performance custom client for developing and managing large databases, built for data architects and DBAs from the design stage.

View details

Database design and implementation

Design, implementation and tuning of MySQL and MariaDB databases for real-time transaction systems: data models, stored procedures, triggers, data marts of more than 27 million rows, and integration of service databases with 30 million user records.

Get in Touch