The Data Engineer, Advanced Analytics platforms will work with our core platform development team as well as domain experts, application developers, controls engineers and data scientists. Their primary responsibility will be to develop reliable and instrumented data ingestion pipelines that land inbound data from multiple process and operational data stores throughout the company to on-premises and cloud-based data lakes. These pipelines will require data validation and data profiling automation along with version control and CI/CD to ensure ongoing resiliency and maintainability of the inbound data flows supporting our advanced analytics projects.
Who can apply?
Bachelor's degree in data engineering, big data analytics, computer engineering, or related field.
Master's degree in a relevant field is advantageous.
Proven experience as a data engineer, software developer, or similar.
Expert proficiency in Python, C++, Java, R, and SQL.
Familiarity with Hadoop or suitable equivalent.
Excellent analytical and problem-solving skills.
A knack for independence and group work.
Skills you’ll bring
Liaising with coworkers and clients to elucidate the requirements for each task.
Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed.
Reformulating existing frameworks to optimize their functioning.
Testing such structures to ensure that they are fit for use.
Preparing raw data for manipulation by data scientists.
Detecting and correcting errors in your work.
Ensuring that your work remains backed up and readily accessible to relevant coworkers.