Office Field is looking for a Data Engineer to join our growing team of analytics experts. They will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection.
Responsibilities:
• Create and maintain optimal data pipeline architecture,
• Assemble large, complex data sets that meet functional / non-functional business requirements
• Evaluate data flows and prepare ETL processing by incorporating business requirements
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Requirements:
• Bachelor’s/Master’s degree in Computer Science, Computer Engineering, or relevant field.
• A minimum of 2+ years’ experience in a similar role
• Hands-on experience with ETL.
• Python experience is required.
• Experience on RDBMS based databases including MongoDb, PostGreSQL, MySQL.
• Familiarity with cloud platforms like AWS, GCP, and Azure.
• Experience with Apache Airflow, NiFi, Atlas, and Kafka is preferred.
• Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
• Strong knowledge of database structure systems and data mining.
• Excellent organizational and analytical abilities.
• Outstanding problem solver.
• Good written and verbal communication skills