Wukong - Big Data Pharma Distribution Management System
Project Overview
A one-stop pharmaceutical distribution data governance platform built on a big data architecture. It addresses the challenges of data fragmentation and analysis latency in the China region, enabling real-time monitoring and intelligent analysis of sales data for large-scale pharmaceutical enterprises.
Industry Pain Points
Data Fragmentation & Integration Difficulty
Sales data is scattered across various distributors and channels with inconsistent formats. Manual aggregation is inefficient and prone to errors, making it difficult to form a unified view of the market.
Analysis Latency
Traditional systems struggle to process tens of millions of sales records efficiently, leading to significant delays in business reporting and missed decision-making windows.
Lack of Standardization
The absence of unified master data standards for drugs, institutions, and personnel hinders effective data asset management and cross-dimensional analysis.
Innovative Solution
Core Methodology
The system establishes a closed-loop data governance framework:
- Unified Data Ingestion: Automated collection and cleaning of flow data from multiple sources.
- Master Data Management (MDM): rigorous standardization of core data dimensions (Products, Hospitals, Representatives).
- Intelligent Analytics: Real-time calculation of sales metrics with automated appeal handling workflows.
Technical Implementation
- High-Performance Architecture: Adopting Spring Cloud microservices backend combined with Spark for big data processing to ensure scalability.
- Hybrid Storage Layer: Utilizing PostgreSQL for relational data, Elasticsearch for high-speed search, and Redis for caching.
- Enterprise-Grade Security: Implementing Shiro + JWT for robust access control and data security.
- Observability: Integrated Prometheus + Grafana for real-time system monitoring.
Value Delivered
- Massive Data Processing: Successfully achieved real-time processing capability for over 10 million flow data records.
- Efficiency Leap: Through digital transformation, operational costs were reduced, and overall management efficiency improved by more than 40%.
- Standardization: Established a unified data standard system, transforming raw data into valuable corporate assets.