Cloud Data Engineer
Kansas City, MO 64114 US
Location: Kansas MO or Boston MA
- Design, implement, and support on-premise and cloud-based data infrastructure that is resilient to disruptions and failures.
- Provide subject matter expertise and hands-on delivery of data acquisition, curation, and consumption pipelines on Azure, Databricks, AWS, and Confluent.
- Maintain the current and emerging state-of-the-art compute and cloud-based solutions and technologies.
- Enhance and support corporate SQL, DWH assets, and streaming data solutions.
- Ensure high uptime for all data services and consider enhanced solutions through scheduled or event-driven design.
- Bring multi-cloud/cross-platform agnostic technologies and practices into the system to enhance reliability and support rapid scaling of the business's data needs.
- Scale up our data infrastructure to meet cross-functional, multi-industry business needs.
- Develop, leverage, and maintain end-to-end data pipelines in production.
- Build effective relationships with internal stakeholders.
- Have familiarity with the technology stack available in the industry for metadata management, including Data Governance, Data Quality, MDM, Lineage, and Data Catalog.
- Have hands-on experience implementing analytics solutions leveraging Python, Spark SQL, Databricks Lakehouse Architecture, and orchestration tools like Kubernetes and Docker.
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer, with a strong background in data infrastructure design and implementation.
- Hands-on experience with cloud-based data platforms like Azure, AWS, and Databricks.
- Strong proficiency in SQL, Python, and Spark.
- Familiarity with metadata management tools and practices.
- Excellent problem-solving skills and attention to detail.
- Strong communication and interpersonal skills.
- Ability to work independently and as part of a team.