Data Engineer – Implementation Consultant

Job title: Data Engineer – Implementation Consultant

Company: Horizontal Talent


Job description: Hybrid – 3 days on site weekly – Irving, TXData Engineer : Implementation Consultant
Summary
We are currently onboarding North America based OPCO’ s (Operating companies) to their new digital platform (Spark) which is built on Kubernetes running in AZURE, the customer and associate experience (CX/AX) on their new SPARK platform in EMEA. They are planning to migrate North American operating companies (OPCOs) to the platform, beginning in 2024.
With this integration work the engineer will be responsible for designing, configuring, and implementing data validation tools which will validate the data transferred between. You will ensure best practices are followed through the implementation lifecycle and help construct data sets for use by the team and other business stakeholders to power both reporting and validation.Job responsibilities

• Highly skilled and motivated Data Engineer
• As a Data Engineer, you will be responsible for validating the data between two systems, ensuring accuracy and consistency.
• Implement data quality checks and monitoring processes.
• Design and Develop data entity validation scripts using python.
• Validate and reconcile data between two systems, ensuring accuracy and consistency.
• Collaborate with cross-functional teams to identify and resolve data discrepancies and issues.
• Develop and implement data quality checks and monitoring processes to ensure data integrity.
• Design and maintain data pipelines and ETL processes to extract, transform, and load data from various sources.
• Optimize data storage and retrieval processes to improve performance and efficiency.
• Perform data analysis and profiling to identify data quality issues and recommend solutions.
• Develop and maintain documentation for data validation processes, data mappings, and data lineage.
• Stay up to date with industry trends and best practices in data engineering and data validation.
• Support migration of North American OPCOs, enabling data validation on the new platform.
• Gather business requirements from key client stakeholders and translate these into technical tracking specifications based on standards and industry best practice.

Required Skills

• Strong knowledge of IPAAS and data validation for migration of applications.
• Demonstrable experience in delivering end to end data validation.
• Confident understanding of web development and its languages and possess Python proficiency.
• Proactive and highly organised with strong time management and planning skills. Able to change direction and work on multiple projects across a wide range of topics.
• [Desired] Knowledge of Python/Google BigQuery architecture.

Horizontal is proud to be an Equal Opportunity and Affirmative Action Employer. We seek to provide employment opportunities to talented, qualified candidates regardless of race, color, sex/gender including gender identity and/or expression, national origin, religion, sexual orientation, disability, marital status, citizen status, veteran status, or any other protected classification under federal, state or local law.In addition, Horizontal will provide reasonable accommodations for qualified individuals with disabilities. If you need to request a reasonable accommodation in order to complete the application or interview process, please contact us. All applicants applying must be legally authorized to work in the country of employment. PandoLogic. Category:Technology, Keywords:Data Engineer, Location:Boston, MA-02108

Expected salary:

Location: Boston, MA

Job date: Tue, 24 Dec 2024 08:32:00 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (jobsnear.pro) you saw this job posting.Thanks&Good Luck