Client is the USA based IT service provider of enterprise non-profit constituent relationship management (CRM) solutions. The client is focused on providing services to leading global nonprofits, media houses and higher educational institutions.
Data Migration is a complex process, requiring a robust methodology and structured framework.
The business need was to migrate all the data from a live legacy CRM database to Salesforce objects and map and validate this data in the production environment. The challenges were three fold –
Understand the structure of the database
Map the entities with Salesforce objects
Keep the legacy CRM database in sync with Salesforce data while managing large volumes of data
Eternus Solutions was engaged with the client in the capacity of an Offshore-based Delivery Center, collaboratively taking care of the data migration from live legacy CRM database to Salesforce.
As the client had given mandate to use Salesforce Data Loader tool for managing the data uploads. The solution approach used ETL (Extract, Transform and Load) framework to implement the following steps:
Creation of replication tables in the legacy database for each object in Salesforce. [Staging Database]
Export data from transaction object (the object to which data is to be uploaded) using Database Data loader/ Export wizard/ workbench and loading it to the database replication table.
Creation of SQL script to extract data from the database by applying necessary conditions on it. [Extract Stage]
Application of the transformation rules and conditions on the SQL script and loading them into staged replication tables. [Transform Stage]
Export data from the database to .csv file using Database Import/ Export wizard or Results to the file (on execution of a script) and uploading the file back to transaction object in Salesforce org using SFDC data loader. [Load Stage]
Validation and reconciliation of all records and objects in Salesforce with actual data in the legacy database.
Figure 1 – Data Migration Architecture with Salesforce.com
Customization of existing standard objects
Creation of new objects
Triggers/workflows, classes to manage the business work flow
Data analytics using business dashboards, reports
Creating new views, stored procedures and functions for ETL in legacy database
Loading of data in the developer sandbox
SRS and design documents to start building any new components
Design and development of workflows for various processes wherever required
Design and development of scripts for various jobs and objects
Development of scripts using best practices and database standards
Data tool configuration using standard editor
Data cleansing and dedup jobs to improve data quality in SFDC