Senior Data Engineer
- CA, United States
$9,507 to $12,740 USD / month
Applications open in a new tab.
Job details
- Pay
- $9,507 to $12,740 USD / month
- Apply by
- Posting language
- English
- Posted
Original job description
Job Description and Duties California’s long-awaited statewide Cradle-to-Career Data System has launched. You can help build a statewide system that brings together existing data with an aim of addressing barriers to opportunity from early learning, through K-12, college, and career. We are hiring a Senior Data Engineer (SDE) to lead the development of data pipelines to ingest, cleanse, transform, and integrate into the Cradle-to-Career Data System. The incumbent will ensure data is available as a service for data warehouses, digital services, and dashboards. The SDE will plan, develop, and document policies and best practices for the Office of Cradle-to-Career Data. We are looking for an engineer who is excited to build something new with a small, entrepreneurial team, using emerging technologies. About the Role As the Senior Data Engineer, you will have responsibility for data lifecycle management, end-to-end. This includes:
- Data Management. Plan, design, develop, and implement processes for data management and ensuring that data are secure at rest, in transit, and in use.
- Data Quality. Design, develop, and document patterns and practices to help ensure all data is profiled, reviewed, and accurate to support critical decisions using industry best practices for continuous integration and continuous delivery.
- Collaborate. Work with colleagues and contractors to build and guide architectural improvements to data infrastructure while simultaneously supporting team members to evolve continuous integration and continuous delivery strategy with robust monitoring, altering and recovery. Your work will be challenging, fun, and focused on enabling Californians to build a more equitable future. You will find additional information about the job in the Duty Statement. Working Conditions This position may be eligible for a telework opportunity in accordance with departmental policies and operational needs. Employees are currently required to work in-person at least four (4) days per week in alignment with Executive Order N-22-25. Additional in-office days may be required based on operational needs. Personal Leave Program: Effective July 1, 2025, state employees are subject to temporary salary reductions ranging from 2% to 4.62% in exchange for Personal Leave Program (PLP) hours. Please note that the salary ranges listed in this Job Control may not reflect these reductions associated with the 2025 Personal Leave Program. Please follow the link for more information regarding the 2025 Personal Leave program: http://hrmanual.calhr.ca.gov/Home/ManualItem/1/2113. The successful candidate will be required to pass a criminal background check (see Education Code 10873). Minimum Requirements You will find the Minimum Requirements in the Class Specification.
- INFORMATION TECHNOLOGY SPECIALIST III Additional Documents
- Job Application Package Checklist
- Duty Statement Department Information The Office of Cradle-to-Career Data (C2C) is a new state investment working to build a statewide data system that will provide tools to help students reach their goals and deliver reliable and actionable information on education and workforce outcomes. California’s information on early education, K-12 schools, colleges, social services, and employment is currently separate and disconnected. That’s why California authorized the creation of the Cradle-to-Career Data System. Through a collaborative 18-month planning process, we designed a data system to be a suite of user-friendly resources focused on early learning through K-12 and higher education, as well as on the financial aid and social services that help students reach their goals. Our vision is to foster evidence-based decision-making to help Californians build more equitable futures and empower individuals to reach their full potential. This is your chance to join a brand-new office to build a transformative set of services to help Californians successfully navigate life from cradle to career.
Department Website:
https://www.c2c.ca.gov Special Requirements • The position(s) require(s) a Background Investigation be cleared prior to being hired. Desirable Qualifications In addition to evaluating each candidate's relative ability, as demonstrated by quality and breadth of experience, the following factors will provide the basis for competitively evaluating each candidate: The ideal candidate would have the following knowledge, skills, and abilities.
- You have 5 or more years of experience with each of the following technologies: AWS, Snowflake, and dbt.
- You have 5 or more years of experience with automating, orchestrating, and maintaining data engineering pipelines end-to-end which includes, but is not limited to, the following: ingestion, validation, quality, transformation, and integration.
- You have 5 or more years of experience protecting and securing sensitive data in accordance with state and federal laws, regulations, and standards which includes, but is not limited to, the following: FIPS, NIST, FERPA, HIPAA, HEA, and the Privacy Act.
- You love engaging with people as much as engaging with data and technology
- You are constantly learning and engaged in the modern data stack ecosystem and enjoy staying up to date on emerging and best practices.
- You have a knack for and enjoy communicating technical and architectural tradeoffs clearly to different audiences.
- You value simplicity and elegance in architecting solutions over needless complexity and have a sixth sense for evaluating platforms that are fit for purpose.
- You like keeping knowledge fresh on platforms and willing to get in and support the team on testing and implementing platforms.
- You value good documentation and guidance to help others successfully use data platforms.
- You take pleasure in sharing your knowledge and experience with others to help them succeed in adopting modern data practices.
- You relish demonstrating the value of a cloud-first approach to data tools and the benefits of applying software engineering approaches to data work and are eager to hands-on engage with project work to ensure that value is communicated.
- You are excited about applying your talents to improve the lives of Californians.
Benefits
Benefit information can be found on the CalHR website and the CalPERS website. Additional Application Information Using the online application system as specified in the announcement is the preferred method for applying for civil service job opportunities; however, applicants may instead apply by way of U.S. mail, parcel delivery or courier service, or in person, as set forth in this announcement.
- Electronic Submission: Application and any required applicable documents may be submitted electronically through CalCareers account. The application packages must be received electronically by 11:59 p.m. on the final filing date as stated on the job vacancy announcement.
- U.S Postal Service Mail: Application and any applicable required documents may be submitted by mail. The envelope must be postmarked before or on the final filing date as stated on the job vacancy announcement. Do not include confidential information such as social security numbers, date of birth, marital status, equal employment opportunity data, examination scores, and LEAP information. Per CCR 249.3 we may fill additional positions from this recruitment. Examination Information Take the online Information Technology Specialist III exam to become list eligible for this position. The Limited Examination and Appointment Program (LEAP) is an optional pathway to state civil service for people with disabilities. Visit the CalHR LEAP page for additional information.
More about this job
Skills
- Data management
- CI/CD
- Liaise with colleagues
- Computer technology
- Tutor students
- AWS
- Snowflake
- dbt
- Data engineering
- Documentation