Note: The job is a remote job and is open to candidates in USA. Community Care Physicians is looking for a full time Sr. Data Engineer to join their IT department. The role involves designing, developing, implementing, and maintaining data pipelines and data models to support healthcare delivery and improve clinical, financial, and patient experience outcomes.
Responsibilities
- Design, build, and maintain scalable data pipelines to ingest, transform, and load data from disparate sources (ex: databases, APIs, third-party feeds, SFTP, etc.)
- Develop and optimize ELT/ETL workflows to ensure reliable data delivery
- Architect and manage data storage solutions
- Implement data validation, monitoring, altering, and observability to ensure accuracy, completeness, and freshness across pipelines
- Troubleshoot and resolve pipeline failures, performance bottlenecks, and data discrepancies, often under time-sensitive conditions
- Design and maintain logical and physical data models that support analytics, reporting, and downstream applications
- Collaborate closely with business stakeholders to understand the business context, use cases, and requirements for data consumers
- Collaborate closely with Analysts to develop and maintain data models, sometimes integrating data from various sources to create a unified view
- Apply engineering best practices (ex: version control, testing, continuous integration, etc.)
- Conduct code reviews and provide technical guidance to ensure adherence to engineering standards and best practices
- Maintain data documentation and definitions
- Support company-wide efforts to improve data literacy, quality, accessibility, and governance
- Develop and maintain automated data quality checks, reconciliation processes, and exception monitoring frameworks
- Keep the managers and business stakeholders informed of progress and blockers
- Provide a consistently high level of customer service and effectively address customer needs
- Provide mentorship, guidance, training, and/or assistance to other team members
- Act as a leader and positive role model to all levels of the team
- Optimize query performance, storage costs, and compute resource utilization
Skills
- Design, build, and maintain scalable data pipelines to ingest, transform, and load data from disparate sources (ex: databases, APIs, third-party feeds, SFTP, etc.)
- Develop and optimize ELT/ETL workflows to ensure reliable data delivery
- Architect and manage data storage solutions
- Implement data validation, monitoring, altering, and observability to ensure accuracy, completeness, and freshness across pipelines
- Troubleshoot and resolve pipeline failures, performance bottlenecks, and data discrepancies, often under time-sensitive conditions
- Design and maintain logical and physical data models that support analytics, reporting, and downstream applications
- Collaborate closely with business stakeholders to understand the business context, use cases, and requirements for data consumers
- Collaborate closely with Analysts to develop and maintain data models, sometimes integrating data from various sources to create a unified view
- Apply engineering best practices (ex: version control, testing, continuous integration, etc.)
- Conduct code reviews and provide technical guidance to ensure adherence to engineering standards and best practices
- Maintain data documentation and definitions
- Support company-wide efforts to improve data literacy, quality, accessibility, and governance
- Develop and maintain automated data quality checks, reconciliation processes, and exception monitoring frameworks
- Keep the managers and business stakeholders informed of progress and blockers
- Provide a consistently high level of customer service and effectively address customer needs
- Provide mentorship, guidance, training, and/or assistance to other team members
- Act as a leader and positive role model to all levels of the team
- Optimize query performance, storage costs, and compute resource utilization
Benefits
- Medical, dental, vision and life insurances
- Paid holidays
- Paid time off
- Retirement plan
Company Overview
Community Care Physicians (CCP) is the largest independent multispecialty medical group in the Capital Region of NY. It was founded in 1997, and is headquartered in Albany, New York, USA, with a workforce of 1001-5000 employees. Its website is https://columbiadev.com.