SFDC – IT Services – Data Migration using SFDC Data Loader – Success Story

Client Overview

Client is the USA based IT service provider of enterprise non-profit constituent relationship management (CRM) solutions. The client is focused on providing services to leading global nonprofits, media houses and higher educational institutions.

Business Challenge

Data Migration is a complex process, requiring a robust methodology and structured framework.

The business need was to migrate all the data from a live legacy CRM database to Salesforce objects and map and validate this data in the production environment. The challenges were three fold –

  • Understand the structure of the database

  • Map the entities with Salesforce objects

  • Keep the legacy CRM database in sync with Salesforce data while managing large volumes of data

Technical Requirements

  • Apex

  • SQL Script

Solution Strategy

Eternus Solutions was engaged with the client in the capacity of an Offshore-based Delivery Center, collaboratively taking care of the data migration from live legacy CRM database to Salesforce.

As the client had given mandate to use Salesforce Data Loader tool for managing the data uploads. The solution approach used ETL (Extract, Transform and Load) framework to implement the following steps:

  1. Creation of replication tables in the legacy database for each object in Salesforce. [Staging Database]

  2. Export data from transaction object (the object to which data is to be uploaded) using Database Data loader/ Export wizard/ workbench and loading it to the database replication table.

  3. Creation of SQL script to extract data from the database by applying necessary conditions on it. [Extract Stage]

  4. Application of the transformation rules and conditions on the SQL script and loading them into staged replication tables. [Transform Stage]

  5. Export data from the database to .csv file using Database Import/ Export wizard or Results to the file (on execution of a script) and uploading the file back to transaction object in Salesforce org using SFDC data loader. [Load Stage]

  6. Validation and reconciliation of all records and objects in Salesforce with actual data in the legacy database.

Figure 1 – Data Migration Architecture with Salesforce.com

Solution Components

  • Customization of existing standard objects

  • Creation of new objects

  • Triggers/workflows, classes to manage the business work flow

  • Data analytics using business dashboards, reports

  • Creating new views, stored procedures and functions for ETL in legacy database

Development Methodology

  • Loading of data in the developer sandbox

  • SRS and design documents to start building any new components

  • Design and development of workflows for various processes wherever required

  • Design and development of scripts for various jobs and objects

  • Development of scripts using best practices and database standards

  • Data tool configuration using standard editor

  • Data cleansing and dedup jobs to improve data quality in SFDC

Share This Case Study