Data Engineer II
- Des Moines, IA, United States
- Des Moines, United States
Applications open in a new tab.
Job details
- Apply by
- Experience
- This position requires a Master’s degree or equivalent in Computer Science, Statistics, or a related field and 2 years related experience.
- Posting language
- English
- Posted
Original job description
Join Vylor - Powering the Future of Agriculture
At Vylor, we’re advancing agriculture through breakthrough science - combining elite germplasm, cutting-edge biotech, and next-generation expertise in gene editing and molecular breeding. Our portfolio includes trusted industry brands like Pioneer®, Brevant®, and Hoegemeyer®, delivering performance farmers rely on.
Join us to help scale innovation globally and shape what’s next in crop science. Join Vylor - Powering the Future of Agriculture.
At Vylor, we’re advancing agriculture through breakthrough science - combining elite germplasm, cutting-edge biotech, and next-generation expertise in gene editing and molecular breeding. Our portfolio includes trusted industry brands like Pioneer®, Brevant®, and Hoegemeyer®, delivering performance farmers rely on.
Join us to help scale innovation globally and shape what’s next in crop science.
Pioneer Hi-Bred International, Inc. a subsidiary of Vylor Inc., seeks a full-time Engineer II based in Johnston, IA. The Engineer II partners with Analytics, Data Science, Research & Development (R&D), Data Engineering, and cross-functional teams to design and deliver scalable data solutions supporting Corteva’s Seeds and Biotech domains and enterprise data platform. Specific duties include: (1) Design, develop, and maintain Lakehouse data pipelines, APIs, and data products supporting seed models, biotech research assets, enterprise applications, dashboards, and analytics; (2) Develop scalable ETL/ELT pipelines using Python, SQL, dbt, Trino, and shell scripting to process and integrate large-scale structured and unstructured agricultural data from enterprise systems, laboratory platforms, geographic datasets, drones, satellites, and IoT devices; (3) Develop and maintain Bronze, Silver, and Gold Layer data assets by integrating data from Exasol, ClickHouse, MSSQL Server, and other enterprise sources and applying transformation, validation, reconciliation, and quality-control processes; (4) Design Lakehouse datasets and transformation pipelines supporting seed, biotech, pathology, and disease analytics, including the integration of laboratory, geographic, and historical research data; (5) Develop and optimize incremental and full-refresh dbt models and complex Trino SQL queries to improve the performance, scalability, and maintainability of Seeds and Biotech data products; (6) Modernize legacy data applications by documenting business rules and source-to-target mappings, migrating ETL logic from legacy and Exasol-based environments to Trino and Lakehouse architectures, and deploying curated datasets to ClickHouse and Gold Layer data products; (7) Develop and enhance PRISM and FRIP data integrations by implementing Trino connectors and end-to-end comparison pipelines with reusable validation and reconciliation logic to ensure consistency between PRISM, FRIP, Lakehouse, Exasol, and downstream application datasets; and (8) Develop reusable frameworks for logging, error handling, scheduling, automated testing, monitoring, deployment, and data-quality validation; troubleshoot application and pipeline integration issues; and create analytics-ready datasets supporting statistical analysis, predictive modeling, regression, classification, clustering, dashboards, and business-intelligence reporting. Utilize Python, SQL, Linux, shell scripting, Git, dbt, Trino, Exasol, ClickHouse, MSSQL Server, Kubernetes, and, Docker. Position includes a telecommute benefit within commuting distance to Johnston, IA Pioneer Hi-Bred/Vylor office, as directed.
This position requires a Master’s degree or equivalent in Computer Science, Statistics, or a related field and 2 years related experience. Must also have 24 months of experience with each of the following: 1) Designing and developing scalable ETL/ELT pipelines using Python, SQL, and shell scripting to extract, transform, validate, reconcile, and integrate large-volume structured, semi-structured, and unstructured data used by enterprise R&D applications, analytical models, dashboards, and reporting systems. 2) Developing ETL design mappings, source-to-target transformation rules, data-reconciliation processes, data-quality controls, and complex SQL transformations to ensure data accuracy and consistency across source and target platforms. 3) Developing and optimizing complex Trino SQL queries and integrations among Lakehouse, Exasol, ClickHouse, MSSQL Server, and other database platforms to deliver curated datasets for analytics-ready datasets supporting R&D models, scientific analysis, enterprise applications such as phenomic pillar, dashboards, and reporting. 4) Developing reusable Python- and Linux shell-based pipeline reliability and observability frameworks for job scheduling, structured logging, exception handling, automated testing, monitoring, data-quality validation, cross-platform reconciliation, and application integration; and using version-control, containerization, and automated-deployment tools to deliver production data products. 5) Analyzing and modernizing legacy data applications by documenting business rules and data mappings, migrating ETL logic to cloud-based or Lakehouse architecture, deploying curated data products, and using Git and Docker for source control, automated deployment, and containerization. Will accept experience gained before, during or after Master’s program. Employer will accept experience gained concurrently. Position includes a telecommute benefit within commuting distance to Johnston, IA Pioneer Hi-Bred/Vylor office, as directed. Please apply online at https://apply.vylor.com/careers/.
Benefits – How We’ll Support You:
- Numerous development opportunities offered to build your skills
- Be part of a company with a higher purpose and contribute to making the world a better place
- Health benefits for you and your family on your first day of employment
- Four weeks of paid time off and two weeks of well-being pay per year, plus paid holidays
- Excellent parental leave which includes a minimum of 16 weeks for mother and father
- Future planning with our competitive retirement savings plan and tuition reimbursement program
- Learn more about our total rewards package here - Vylor Benefits
- Check out life at Vylor! https://www.linkedin.com/company/vylorgenetics/
Are you a good match? Apply today! We seek applicants from all backgrounds to ensure we get the best, most creative talent on our team.
Vylor is an equal opportunity employer. We are committed to embracing our differences to enrich lives, advance innovation, and boost company performance. Qualified applicants will be considered without regard to race, color, religion, creed, sex, sexual orientation, gender identity, marital status, national origin, age, military or veteran status, pregnancy related conditions (including pregnancy, childbirth, or related medical conditions), disability or any other protected status in accordance with federal, state, or local laws.