Note: The job is a remote job and is open to candidates in USA. Tredence Inc. is a data science and analytics company, and they are seeking an Associate Manager in Data Engineering to manage end-to-end delivery and optimize data pipeline architecture. The role involves working cross-functionally with stakeholders, following Agile methodologies, and managing teams to build high-volume distributed systems in a SaaS environment.
Responsibilities
- Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders
- Follow the Agile development methodology; think strategically and execute methodically
- Develop and manage capacity and growth projection forecasts of the environment within budgets
- Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements
- Drive optimization, testing and tooling to improve quality of solutions
- Manage teams that build and operate high volume distributed systems in a SaaS environment
- Great at devising efficient processes that increase velocity and quality
- Managing and administering Databricks environment include managing workspace setup, user permissions, cluster configuration, security policies, and cost optimization
Skills
- Bachelor's degree (or foreign equivalent) in Data Science, Information Technology, or related field
- Five (5) years of experience in the job offered or a related position
- Demonstrable knowledge of: Python
- Demonstrable knowledge of: SQL
- Demonstrable knowledge of: Databricks
- Demonstrable knowledge of: Snowflake
- Demonstrable knowledge of: Azure Data Lake Storage
- Demonstrable knowledge of: Azure Data Factory
- Demonstrable knowledge of: Power BI
- Demonstrable knowledge of: Apache Spark
- Demonstrable knowledge of: Apache Airflow
- Demonstrable knowledge of: GitHub CI/CD
- Demonstrable knowledge of: Kubernetes
- Travel to unanticipated client locations throughout the U.S. approximately 30%, as required
- May telecommute from any location within the U.S
Company Overview
Tredence is a global data science solutions provider focused on solving the last mile problem in AI. It was founded in 2013, and is headquartered in San Jose, California, USA, with a workforce of 1001-5000 employees. Its website is http://tredence.com.