Job Description
On behalf of our client in the US, Affinity is looking for a Data Engineer in Pakistan to work closely with the data and development team responsible for designing, building, and maintaining data-driven applications and systems to ensure their quality and functionality. This is a remote contract in the PST timezone.
Responsibilities:
- Design, develop, and maintain robust data pipelines and ETL processes to ingest, process, and transform data from various sources.
- Collaborate with data scientists, analysts, and developers to understand data requirements and ensure that the data infrastructure meets their needs.
- Ensure data quality and integrity through the implementation of data validation and monitoring mechanisms.
- Develop and optimize complex SQL queries for data extraction, transformation, and loading.
- Implement and maintain data warehousing solutions, including the design of star schema and snowflake schema models.
- Manage and optimize database performance, including indexing, partitioning, and query tuning.
- Participate in code reviews and provide feedback to improve the overall quality of data pipelines and infrastructure.
- Develop and maintain comprehensive documentation for data engineering processes, procedures, and best practices.
- Stay up-to-date with emerging trends and technologies in data engineering and implement them as appropriate.
Requirements:
- 7+ years of experience in data engineering, including the design and implementation of data pipelines and ETL processes.
- 5+ years of experience with data management and database technologies, including Enterprise Data Warehousing, ETL, data migration, star schema, and snowflake schema.
- Proficiency in SQL, with the ability to write efficient queries and optimize database performance.
- Experience with business intelligence tools, such as PowerBI, to create and manage data visualizations and reports.
- Strong problem-solving skills and the ability to troubleshoot and resolve data-related issues.
- Excellent communication skills and the ability to work collaboratively with cross-functional teams.
- Experience with Azure is an asset.