Big Data Engineer - Government Sector
Job Location:
Monthly Salary:
Posted:
Application Deadline:
Vacancies:
Job Summary
Apt Resourcesis seeking an experiencedBig Data Engineerfor agovernment client in Abu Dhabi. You will design and implement large-scale data solutions to support AI/ML initiatives and public sector digital transformation.
Data Pipeline Development:
- Build robust data pipelines usingPython SQL/NoSQL and Airflow
- DevelopETL/ELT processesfor structured/unstructured data
- Managedata lakesand optimize storage solutions
Data Infrastructure:
- Design efficientdata modelsfor analytics
- Implementdata governanceand quality frameworks
- Work withcloud-based data platforms(Azure preferred)
AI/ML Support:
- Prepare and process datasets for machine learning applications
- Collaborate with ML teams on feature engineering
Requirements
- 10-12 yearsof hands-on big data experience
- Expertise in:
- PythonandSQL/NoSQLdatabases
- Airflowfor workflow orchestration
- ETL/ELTpipeline development
- Cloud data platforms(Azure AWS or GCP)
Benefits
To be discussed
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Providing Apt Recruitment Solutions Experts who make sure that your recruitment needs are handled using only best practices Lead by professionals with a collective experience of over 3 decades in the recruitment segment, within various business verticals. Our company has evolved throu ... View more
