DE Jobs

Search from over 2 Million Available Jobs, No Extra Steps, No Extra Forms, Just DirectEmployers

Job Information

Onix Networking Corp. Databricks Engineering Lead - AWS & Databricks in Lakewood, Ohio

Role: Databricks Engineering Lead - AWS & Databricks Full time Professional Remote - Nationwide About Onix: Onix is a leading cloud consulting company that helps customers get the most out of their technology with innovative, cloud-powered solutions and best-in-class services. We offer cloud solutions across various use cases and industries, from migration to advanced analytics and innovative AI solutions. With our global team of accomplished cloud experts, we are the most trusted cloud partner in the industry. Summary: Onix seeks an experienced Databricks Engineering lead with a proven track record in production-level Databricks and AWS infrastructure and data engineering implementations to join our delivery team. The ideal candidate will strongly understand Lakehouse Architecture, ETL solutions, and designing, implementing, and maintaining the infrastructure required to support Databricks deployments. They should have a strong background in software development, particularly in building utilities and solutions using Terraform, Python, and pySpark within Databricks. You will collaborate with cross-functional teams, including client executives, architects, engineers, and business stakeholders, to understand their requirements and translate them into robust cloud solutions. The candidate will have hands-on experience with both Databricks and AWS. This role required being a self-starter and may include overseeing other engineers' work. Location: Remote - US, Support EST business hours Scope/Level of Decision-Making: This exempt position operates under limited decision-making and supervision. Position performs various assigned activities, referring more complex issues to the manager. Primary Responsibilities: You will lead the design, development, and implementation of enterprise-level Databricks solutions, including, but not limited to, developing and optimizing Databricks clusters, Unity Catalog, and Delta Tables and ensuring the efficiency and reliability of data processing workflows. Provide leadership and technical expertise in designing, building, and optimizing Databricks to ensure performance, scalability, and cost-effectiveness. Collaborate with business stakeholders, data engineers, data scientists, and other teams to understand data requirements, use cases, and business objectives. Design, implement, and optimize security best practices to ensure the confidentiality, integrity, and availability of data processed by Databricks clusters. Optimize and tune data processing frameworks, data ingestion mechanisms, and data storage strategies for performance and cost efficiency. Ensure data quality, integrity, and governance standards are met throughout the data engineering lifecycle. Automate deployment and management tasks using infrastructure-as-code tools such as Terraform or CloudFormation. Create and maintain technical documentation, run books, code, and best practices for data and machine learning engineering on the Databricks platform. Stay up-to-date with the latest advancements in data analytics, Databricks, and related technologies, and propose innovative solutions to enhance our capabilities. Consult on Professional Services Engagements to help our customers design and implement data warehouse solutions. Lead and develop best practices for the larger data analytics delivery team. Provide client presentations to review project design, outcomes, and recommendations. Provide technical guidance and support to other members of the team. Minimum Qualifications & Skills . 6+ years of experience in a customer-facing or consulting role. 7+ years of experience in software development, with a focus on data engineering and analytics. Experience with Big Data technologies, Analytic Warehousing technologies, data processing technolo

DirectEmployers