Data Engineer Lead (ETL)

Data Engineer Lead (ETL)

Novare Technologies Inc
5-8 years
Not Specified

Job Description

Technology professional who will be responsible for all aspect of data integration and migration.The Senior ETL Developer is a high-level position which will lead other ETL Developers involved in projects and guide in making solutions development to implementation.
Roles and Responsibilities
  • Analyze, design, develop, implement and support ETL solutions using suitable data loading techniques including but not limited to Push-Down Optimization for performance optimization
  • Develop data integration jobs for ingesting data to a Big Data Platform which includes creating and maintenance of optimal data pipeline architecture
  • Develop design specifications within the defined architecture using standard procedures and techniques based on the provided requirements
  • Develop different data marts, perform ETL, developing BI repositories, and BI administration/reporting
  • Develop architecture to implement data quality and data cleansing procedures.
  • Analyze impact of different changes with the existing ETL/ELT processes and systems. Assess the compatibility with goals in all areas including cost effectiveness and feasibility.
  • Translate business requirements and technical designs into well-developed solutions that meets business KPI goals.
  • Design database queries, views and functions to enable reporting and data analytics
  • Design and implement technology best practices, guidelines and repeatable processes and optimize as well as refactor SQL databases and database objects, ETL processes, reporting and analytic solutions in support of business needs/demands
  • Maintain and Troubleshoot application issues independently
  • Provide deployment and post deployment support
  • Participate in code reviews and ensure that all solutions are aligned to pre-defined architectural and requirement specifications
  • Recommend the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL on premise or in the cloud
  • Debug and tune data integration processes; analyze data warehouse architecture, normalized/de-normalized, star schemas and snowflakes, slowly changing dimensions, dimensional surrogate key handling, exception data processing, troubleshoot and recommendimprovements and alternate methodologies.

Job Competencies
  • Bachelors/Master’s Degree in Computer Science/Information Technology, or equivalent experience preferred
  • ETL Development using SSIS
  • Power BI Fact Tables creation
  • Power BI dashboards and reports creation
  • Strong Experience in data integration and migration
  • Experience in at least 1 Full Life Cycle Development
  • At least 5 years’ working experience in data modeling, development, implementation and support of transactional databases and data warehouses in the areas of ETL Development and Data Integration
  • Experience with ETL tools (Talend, Informatica, etc.) and be able to build complex transformations
  • Experience in Business Intelligence and reporting and analytical tools
  • Understanding of data quality management and monitoring
  • Proven knowledge of databases, SQL, scripting languages, ETL, and file transfer automation
  • Experience in ETL tools preferably with Talend, SQL/Stored procedure on Oracle or other DBMS
  • Data warehouse experience using different database technologies (Oracle, AWS, Teradata, etc.)
  • Experience with one of the object-oriented/object function scripting languages: Python, Java, C++, Scala, etc. (is a plus)
  • Experience with Big Data is a plus
  • Key Technical Skills.
    • ETL Architecture, Design and Development 5+ years)
    • Data Modeling (3+ years)
    • SQL Programming (3+ years)
    • Oracle, MySQL, MS SQL, PostgreSQL and DB2 experience
    • Unix/Linux Shell Scripting
  • Non-Technical/ Non-Functional Skills
    • Problem-Solving and Analytical Skills. Must be able to identify potential issues and problems; Must be able to analyze and logically breakdown these issues and problems; Must then be able to create hypotheses that is useful when troubleshooting and testing; Must finally be able to devise efficient solutions and approaches.
    • Project management Skills. Must be able to manage one’s own workload as well as the workload of one's team; Must ensure that appropriate planning, organizing and delegating is in place.
    • Product Knowledge Mastery. Must be able to facilitate and build end-user/client confidence in produced software and application solutions.
  • Candidate must exhibit Novare’s core values which are:
    • Integrity
    • Excellence
    • Innovation
    • Service Orientation
    • Teamwork
    • Global Thinking and Acting
  • Interpersonal and Communication Skills. Must be able to effectively communicate with
    clients and all levels of staff verbally and in writing using Filipino and the English language

Similar Jobs

People Also Considered

Career Advice to Find Better