Senior Data Engineer

Responsibilities:

• Leverage Spark / Hadoop ecosystem knowledge to design and develop capabilities to deliver innovative and improved data solutions.
• Build scalable data pipelines to ingest data from a variety of data sources, identify critical data elements and define data quality rules.
• Collaborate, coach, and mentor colleagues in an energetic, growing team
• Define the architecture, scope and deliver various Big Data solutions.
• Support the bug fixing and performance analysis along the data pipeline
• Support other teams by providing guidance on data modeling, data usage, processing and how they can best leverage the platform
• Provide insights on area of improvements including Data Governance, best practices, large scale processing
• Build and maintain large scale deployment of Cassandra cluster.