Note: The job is a remote job and is open to candidates in USA. Scorpion is the leading provider of technology and services helping local businesses thrive. The Senior Data Engineer will play a critical role in building and evolving the trusted data foundation that powers Scorpion's AI products, tools, and decision-making.
Responsibilities
- Evaluate and improve data quality, completeness, and consistency across 30+ databases, applications, platforms, and APIs
- Design and build Scorpion's analytical data platform, creating a trusted source of truth for business and client data
- Develop and maintain scalable data pipelines that efficiently move data from operational systems into the analytical platform
- Help teams transition from querying production databases directly to using trusted analytical data sources
- Design data access patterns that enable AI agents and applications to quickly retrieve relevant client and business information
- Build secure, scalable solutions that deliver client context and business insights to internal applications and AI-powered experiences
- Define, monitor, and improve service level agreements (SLAs) for data freshness, availability, reliability, and performance
- Partner with engineering, product, and data science teams to establish data standards, governance practices, and data contracts
- Continuously improve the scalability, performance, and reliability of Scorpion's data ecosystem
Skills
- Bachelor's degree in Computer Science, Data Engineering, Information Systems, Software Engineering, or a related technical field, or equivalent practical experience
- 7+ years of data engineering experience, including designing and operating production-scale analytical data platforms
- Experience building scalable data pipelines, analytical systems, and data platforms in modern cloud environments
- Experience integrating and unifying data from multiple systems into trusted, business-ready analytical platforms
- Experience supporting data access and consumption patterns for applications, analytics, machine learning, or AI-powered solutions
- Experience designing scalable data models that support analytics, reporting, and AI-driven applications
- Experience establishing data governance standards, data contracts, and documentation practices across teams
- Deep expertise with Databricks, Delta Lake, and Apache Spark for large-scale data processing, streaming ingestion, and data transformation
- Experience working with Snowflake, BigQuery, ClickHouse, Azure Synapse, or similar analytical database technologies
- Advanced SQL skills, including query optimization, execution planning, and performance tuning
- Strong Python skills for data pipeline development, automation, transformation, and integration with production systems
- Experience building and managing data pipelines using dbt, Airflow, Prefect, or similar orchestration and transformation tools
- Strong understanding of lakehouse architecture, data partitioning strategies, metadata management, and data security best practices
- Ability to collaborate effectively across engineering, product, data science, and business teams
- Strong communication skills with the ability to translate business requirements into scalable data solutions
- Strong analytical and problem-solving skills with a focus on building scalable, maintainable systems
- Ability to balance long-term platform strategy with near-term business priorities
Benefits
- 100% employer-paid medical, dental, and vision insurance
- Flexible paid time off, so you can rest, relax, and recharge away from work
- Paid parental leave
- Paid cell phone and service
- Remote office allowance
- Professional development and development courses
- Regular manager check-ins to drive performance and career growth through Lattice
Company Overview