SENIOR DATA ENGINEER - The Emirates Group
Posted on :
31-12-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Job Purpose: The Senior Data Quality & Automation Engineer is a fullyparticipating member of a crossfunctional team working autonomously on technology development and problem resolution in the Enterprise Data & Analytics space. The role involves hands on contributing to quality practices along with designing and implementing data quality and automation platforms. They will also provide support to technical analytics solutions and products that support Emirates Airlines and the Emirates Group businesses.
As a SENIOR DATA ENGINEER QUALITY & AUTOMATION you will:
- Work closely with product owners analysts software engineers and architects to understand the technical landscape and context of deliveries to refine complex functional and nonfunctional requirements and translate it into fit for purpose acceptance tests.
- Work on problems of diverse scope where analysis of data requires evaluation of identifiable factors and select methods to validate and automate the solution.
- Build test strategies and test plans validating the core business problem and translating them into tests around code functionality data quality performance and security.
- Build and support generating or mocking of test data for exploratory analysis and running tests.
- Design and build automated tests / jobs of moderate to high scope and complexity across all stages of the data pipeline while demonstrating good coding & design practices and adhering to published coding standards and guidelines.
- Build and enhance data quality rules and platforms for observability across the data pipeline
- Debug complex issues resolve blockers and follow design documents with minimal or no supervision.
- Conduct data analysis activities such as source system analysis data modelling data dictionary collection data profiling and sourcetotarget mapping ensuring delivery on business needs.
- Support in updating data inventories and registries as required to keep metadata and data lineage uptodate following agreed Data Governance standards guidelines and principles.
Qualifications & Experience: To be considered for the role you must meet the below requirements:
- In a relevant field such as Computer Science Computational Mathematics Computer Engineering or Software Engineering.
- Specialization or electives in a Data & Analytics field (e.g. Data Warehousing Data Science Business Intelligence) a nicetohave
- 2 years Data Engineering experience with focus on quality & automation
- Extensive handson experience with developing API automation frameworks.
- Minimum 2 years of testing automation and support experience in analytics applications such as Data Lake and Data Warehouse (preferably using the Big Data stack and Microsoft Azure cloud infrastructure)
- Seasoned in identifying quality issues across complex data pipelines running on big data technologies and defining rules for validating health of the data
- Experienced in a wide variety of testing methods and tools covering functional performance security tests across individual jobs pipelines and end to end across enterprise.
- Well versed in building automated checks running in a CI pipeline to validate the ETL / ELT jobs are performing as expected
- Experience with batch and realtime data ingestion/integration tools and technologies handling massive quantities of data (structured and unstructured)
- Exposed to data architecture concepts such as data modelling Big Data storage and dimensional modelling
- Exposed to working with jobs in data pipelines and define metrics / measures to ensure correctness of the data
- Programming (Python or Scala) and SQL querying skills is required
- Exposure to Spark & airline industry experience is nicetohave
- Ability to drive quality of data assets independently and Able to deliver solutions (and associated value) collaboratively
- Strong expertise with contextdriven and exploratory testing with practical experience in using a number of testing heuristics.
- Experience working with VMs and containers both onprem and cloud offerings like Amazon and Google Cloud.
- Operates with a You Code It You Own It mindset (i.e. supports the products they build)
- Team player; able to collaborate with others to remove blockers solve complex design problems and debug/resolve issues
- Is accountable and displays positive attitude
- Selfstarter and has passion for exploring and learning new technologies especially those in the Enterprise Data & Analytics space
Salary & Benefits: Join us in Dubai and enjoy an attractive taxfree salary and travel benefits that are exclusive to our industry including discounts on flights and hotels stays around the world.
This job has been sourced from an external job board.
More jobs on
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobs.ae is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
