Case Study: Converting a batch based file integration to real-time event driven solution

​

About 

​

DiCouple, a WinningEdge company based out of the DC metro area, provides boutique consulting services to commercial, government and state clients. We help companies build IT Solutions & design application architectures on the principles of loose coupling and event driven architecture. 

Our customer is a Federal contractor providing services to a well-known government agency within the United States. To maintain their high standards, they are constantly seeking innovative ways to enhance their operations and processes. 

​

Challenge 

​

The customer was facing difficulties with their existing batch-based file integration system. This outdated method posed significant challenges, including stale data and data synchronization issues. These problems hindered real-time decision-making and compromised the accuracy and efficiency of their operations. They required a modern and reliable solution to transform their integration processes and overcome these obstacles. 

​

Solution 

​

Our team collaborated closely with the contractor to devise an innovative solution that would address their challenges effectively. The team proposed an advanced integration architecture based on event-driven principles and leveraging cutting-edge AWS services. 

At the core of the solution was Amazon EventBridge, which served as the reliable event bus. It enabled real-time communication and coordination among various components of the integrated system. Amazon DynamoDB provided a scalable and flexible NoSQL database to store and manage the data required for processing. 

We also used Amazon Step Functions to orchestrate the complex integration workflows seamlessly. This serverless workflow service allowed for the creation and management of state machines that define and automate the sequence of events and actions within the system. 

Furthermore, the team implemented an API-based integration approach that utilized event sourcing, Command Query Responsibility Segregation (CQRS), and projections patterns. This modern approach ensured data consistency, improved performance, and simplified maintenance of the integrated system.

​

Outcome 

​

The customer was thrilled with the remarkable outcomes achieved through our expertise and the solution. The successful conversion from batch-based file integration to real-time integration using an event-driven architecture brought about numerous benefits. 

​

The initial solution was completed within the stipulated time frame of 9 months. The customer was highly impressed with the rapid implementation and the cost-effective nature of the solution. The cloud costs were optimized, resulting in significant savings, with an estimated annual expenditure of only $25,000. 

The new cloud-native and serverless architecture provided unmatched scalability, flexibility, and reliability. The users gained the ability to effortlessly scale up or down their operations based on demand, ensuring optimal resource utilization and cost efficiency. 

​

Our team’s innovative solution and design expertise empowered the customer to make informed decisions in real time, leading to enhanced operational efficiency and superior customer service. The successful integration of various systems enabled seamless data exchange, eliminating data staleness and synchronization issues.