Azure Data Engineer
Azure Data Engineer
Posted on :
15-08-2021
Employer Active
1 Vacancy
The job posting is outdated and position may be filled
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Jobs by Experience
0 - 10 years
Monthly Salary
AED 1 - 2
Nationality
Any Nationality
Gender
N/A
Vacancy
1 Vacancy
Posted on :
15-08-2021
Job Description
- The Data Engineer will support with building a data pipeline that transforms raw, unstructured data into formats to be used by data scientists and BI for analysis.
- This involves the extraction of data from various data source systems, processing and storing of data into the warehouse system.
- The role will assist in the creation of the processing and big data infrastructure as well as the applications and tools which run on top of it and will monitor data quality to ensure alignment with internal external regulatory requirements.
- Support the creation of an optimal data pipeline architecture and work closely with data scientists in developing architecting solutions as well as monitoring the data quality to ensure accuracy and reliability.
- Assemble large and complex data sets that meet functional and non-functional business requirements.
- Extract and organize data from various data source systems, transforming it into the staging area and loading it into a data warehouse system through ETL process (Extract, Transform, Load)
- Provide suggestions on the identification of internal process improvements including automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability.
- Support the Senior Data Engineer in building analytics tools to provide actionable insights into client acquisition, operational efficiency and other key business performance metrics.
- Assist the Senior Data Engineer in building the infrastructure and relevant solutions required for optimal extraction, transformation and loading of data from a wide variety of data sources using SQL and Azure “big data” technologies.
- Support in the design of data models with the use of development tools (such as PySpark, Scala Spark) to build prototypes and evaluate results for effectiveness and feasibility.
Employment Type
Full Time
Department / Functional Area
Key Skills
Report This Job
Disclaimer: Drjobs.ae is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
