Data Engineer

  • Needs to hire 2 Freelancers

    Job Overview

    We are looking for a Data Engineer who will be part of our Analytics Practice and will be expected to actively work in
    a multi-disciplinary fast paced environment. This role requires a broad range of skills and the ability to step into
    different roles depending on the size and scope of the project; its primary responsibility is the acquisition,
    transformation, loading and processing of data by developing Data Pipelines using Azure Services like Azure Data
    Factory, etc.

    Responsibilities:

     Engineer a modern data pipeline to collect, organize, and process data from disparate sources as part of
    Analytics Product & Solution development
     Performs data management tasks, such as conduct data profiling, assess data quality, and write SQL queries to
    extract and integrate data
     Develop efficient data collection systems and sound strategies for getting quality data from different sources
     Consume and analyze data from the data pool to support inference, prediction and recommendation of
    actionable insights to support business growth.
     Design and develop ETL processes using tools and scripting. Troubleshoot and debug ETL processes.
    Performance tuning and opitimization of the ETL processes.
     Provide support to new or existing products / applications while recommending best practices and leading
    projects to implement new functionality.
     Collaborate in design reviews and code reviews to ensure standards are met. Recommend new standards for
    visualizations.
     Learn and develop new ETL techniques as required to keep up with the contemporary technologies.
     Reviews the solution requirements and architecture to ensure selection of appropriate technology, efficient use of
    resources and integration of multiple systems and technology.
     Support presentations to Customers and Partners
     Advising on new technology trends and possible adoption to maintain competitive advantage

    Experience Needed:

     7+ years of related experience is required.
     B.E. / B.Tech / M.Tech in Computer Science or related technical discipline is required
     Must have demonstrated development experience on MS Azure Cloud
     ETL experience with data integration to support data marts, extracts and reporting
     Experience connecting to varied data sources
     Excellent SQL coding experience with performance optimization for data queries.
     Understands different data models like normalized, de-normalied, stars, and snowflake models. Worked with
    transactional, temporal, time series, and structured and unstructured data.
     Worked in big data environments, cloud data stores, different RDBMS and OLAP solutions.
     Experience in cloud-based ETL development processes.
     Experience in deployment and maintenance of ETL Jobs.
     
     
    Project Type:Ongoing project
     
     

    Skills and expertise

    Data Analytics Skills
    Big Data
    Other
    ETL Pipeline Microsoft Azure SQLcoding

Ask A Question