Other -- Others

Big Data Architect/ Technical Lead

Chennai

2-4 Years

Innova Solutions

Position Overview:

•  Data engineers are mainly tasked withtransforming data into a format that can be easily analyzed. They do this by developing,maintaining, and testing infrastructures for data generation.

•  Data engineers work closely with our datascientists and are largely in charge of architecting solutions for datascientists that enable them to do their jobs.

What are we looking for?

• We are looking foran accountable, multi-talented Data Engineer to facilitate the operations ofour Data Scientists. The Data Engineer will be responsible for employingmachine learning techniques to create and sustain structures that allow for theanalysis of data, while remaining familiar with dominant programming anddeployment strategies in the field.

•  During various aspects of this process, youshould collaborate with coworkers to ensure that your approach meets the needsof each project.

•   Toensure success as a Data Engineer, you should demonstrate flexibility,creativity, and the capacity to receive and utilize constructive criticism. Aformidable Data Engineer will demonstrate unsaturated curiosity and outstandinginterpersonal skills.

Responsibilities and Duties:

• Create andmaintain optimal data pipeline architecture.

•  Assemble large, complex data sets that meetfunctional/non-functional business requirements.

•  Identify, design, and implement internalprocess improvements : automating manual processes, optimizing data delivery,re-designing infrastructure for greater scalability, etc.

•  Build the infrastructure required for optimalextraction, transformation, and loading of data from a wide variety of datasources using SQL and AWS 'big data' technologies.

•  Build analytics tools that utilize the datapipeline to provide actionable insights into customer acquisition, operationalefficiency and other key business performance metrics.

•  Work with stakeholders including theExecutive, Product, Data and Design teams to assist with data-related technicalissues and support their data infrastructure needs.

•  Keep our data separated and secure acrossnational boundaries through multiple data centers and AWS regions.

•  Create data tools for analytics and datascientist team members that assist them in building and optimizing our productinto an innovative industry leader.

• Work with data andanalytics experts to strive for greater functionality in our data systems.

Required Qualifications for Data Engineer:

• Advanced workingSQL knowledge and experience working with relational databases, query authoring(SQL) as well as working familiarity with a variety of databases.

• Experiencebuilding and optimizing 'big data' data pipelines, architectures and data sets

• Experienceperforming root cause analysis on internal and external data and processes toanswer specific business questions and identify opportunities for improvement.

•  Strong analytic skills related to working withunstructured datasets.