Data Engineers develop modern data architecture approaches to meet key business objectives. You would help understand business the potential that data brings to solve the most pressing problems by implementing the best possible solutions
You’ll spend time on the following:
·You will partner with teammates to create and maintain data ingestion frameworks on Kafka & Spark streaming and Batch pipelines for multi TB Data Environments with Clickstream and User activity data
·In depth understanding of programming language like Java, Python or Scala expert level skills is a must
·processing data solution using Cohorts & targeted segmentation for customer focused applications like Customer Data Platform (CDP)
·You will collaborate with Data Scientists in order to design scalable implementations of their required models You have a deep understanding and experience on Scala and Python languagesto develop and deploy code.
·You have built large-scale data pipelines and data-centric applications using any of the distributed platforms like S3, Redshift,HbaseOozie.
·Hands on exposure on Elasticsearch, Redis, CDN & SQS for user Personalization in a production setting will be Plus
·You will pair up with your data engineers to write & review clean and code based product team’s requirements
·Leverage various continuous delivery practices is to deploy, support and operate data pipelines sources as APIs
·Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
·Create data models and speak to the data scientist on different modelling approaches is a plus
·Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process will be a plus
·Good understanding of Agile methods or equivalent to achieve quality and process to your delivery will be a plus
Here’s what we’re looking for:
·You’re genuinely excited about data infrastructure and operations with a familiarity working on AWS cloud
·Working with data excites you and you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all manage within distributed systems to scale out when in need
·You are comfortable taking data-driven approaches and return insight from the data and applying data security strategy to solve business problems.
·Advocate your data engineering expertise to the broader tech community and act as a mentor for more junior-level data engineers.
·You love coding and practiced to implement the best possible solution to a key business problem
·You have a track record of innovation and expertise in Data Engineering
·You’re passionate and have applied your expertise across a range of industries and organizations on Data Engineering solutioning and helping Data Science initiatives.