ETL Lead

Company: CYNET SYSTEMS
Location: Montgomery
Posted on: May 28, 2023

Job Description:

Job Description:

• 
  
• Knowledge of Azure Data Factory is a must and good to have knowledge of other tools as well like SSIS, Talend, etc.
  
• Hands-on experience in migration projects on Azure Cloud.
  
• Should be able to evaluate and provide the best ETL tool as per data migration requirements.
  
• Hands-on experience in migration projects using Azure Data Factory from SQL Server, DB2 (LUW or Mainframe), Mainframe database( VSAM, Flat files, DB2) to Oracle ( If do not have experience in this, should have exp from any relational source to a cloud database using ADF).
  
• experience in validating Data migration.
  
• Experience in writing Python scripts and Azure DataBricks.
  
• Hands-on experience in data extraction ( Full data + Incremental data) strategies from source systems.
  
• Source systems like a relational database SQL Server, DB2, mainframe database VSAM files / flat files / Sequential files.
  
• Hands-on experience in implementing bi-directional synchronization and what database configurations need to be done in the database to enable bi-directional sync.
  
• Documents all technical and system specifications documents for all ETL processes and perform unit tests on all processes and prepare required programs and scripts.
  
• Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities.
  
• Gather requirements and business process knowledge in order to transform the data in a way thats geared toward the needs of end users.
  
• Maintain and improve already existing processes.
  
• Ensure that the data architecture is scalable and maintainable.
  
• Work with the business in designing and delivering correct, high-quality data.
  
• Investigate data to identify potential issues within ETL pipelines, notify end-users, and propose adequate solutions.
  
  
  

Keywords: CYNET SYSTEMS, Montgomery , ETL Lead, Other , Montgomery, Alabama