Title:  Data Engineer

Data Engineer

What this role is about?

The Data Engineer position exists to perform development, solution rollouts, and support for Markets & Regions Data services area, and works under the guidance of senior data engineers & Team Leads to maintain and develop pipelines.

The scope includes using software engineering concepts to architect, design, develop, maintain, test, and evaluate software solutions, and lead continuous delivery process improvement with Azure Data Factory, Data Lake, Data Bricks, Azure SQL, SSIS, and Synapse.

You will analyze, organize, and combine raw data from different sources and build the corresponding data systems and pipelines to ensure that business needs and objectives are met with the data delivered.

You will work on the Agile ways of working currently implemented in JTI and will work on specific workstreams that contains web/mobile applications specific for a business area.

What will you do?

Develop and maintenance of data pipelines, including:

• Develop the data pipelines for the corresponding projects ensuring that are highly available, scalable, reliable, secure, and cost-effective
• Support technical design, development, unit testing, and production deployment. 
• Design and document the pipeline developments
• Writes unit/integration tests, contributes to engineering wiki, and documents work.
• Supports user testing during the UAT phase and works on bug-fixing
• Support Rollouts and deployments.
• Ensure Data pipelines maintenance and performance testing.

Issue resolution and operational support

• Provide timely technical support for issue resolution including UAT and Post Go-Live support, including data maintenance and user access administration. Work with end users, and other support teams and the vendor if required
• Closely collaborate with BTS, Enterprise Architecture, GDC, or other IT groups  
• Timely update assigned tasks, provide responses and solution within the agreed team's timelines
• Daily monitor for running pipelines ensuring correctness of the execution and no business disruption
• Raise and investigate Incidents in the IT Service Portal

Platform configuration and developments

• Ensure that standards are applied and adopt new ones coming as part of the expected evolution
• Support technical design, development, and unit testing, and production deployment.  Ensure that the solution is aligned with the agreed business process design, functional design, and with Microsoft Azure best practices and JTI architecture standards
• Promote DEV/QA/PRD changes, support user testing, fine-tune the solution based on testing feedback
• Ensure consistency & standardization of the data pipelines
• Ensure that required system documentation is completed and delivered before Go-Live and contribute to Knowledge Base creation

Project Management & Business Partnership:

• Communicate timely on the project progress related to developments in assigned area; manage the processes of requests, approval, specifications, development, documentation, and unit testing; coordinate between on-site and off-site teams related to processes in assigned area; coordinate IT-related issue with global IT and other teams
• Development of relationships with customers to understand their needs and priorities, by collecting input from customers and stakeholders; identify and propose process/service / role design improvements geared towards simplification and service level enhancement

What are we looking for?

• College or University degree
• 1+ year of experience in Data and Analytics from a modeling and reporting standpoint
• 1+ year exposure to IT architecture and solutions for data flows among systems and applications
• 1+ years delivering solutions on the Microsoft Azure platform with a special emphasis on data solutions and services - Data Factory, Data Lake, Data Bricks, Azure SQL, SSIS, and Synapse
• Fast learner and able to embrace new technologies
• Experience with ETL tools preferably Azure Data Factory and DataBricks (or similar)
• Azure Data Lakes experience and PBI are a big plus
• Strong analytical skills and troubleshooting skills
• Should have good knowledge of testing and validating data solutions
• Database skills, scripting, and data modeling
• Very good written and spoken English

What are the next steps – Recruitment Process:

Thank you very much for your interest in the role. You are welcome to apply. Feedback will be provided to all interested candidates throughout the recruitment process.