REMOTE: Senior Lead Consultant (Databricks Architect)

Job#: 2036578

Job Description:

• Lead the design and delivery of Apex’s Data Platform Modernization approach and framework with clients in various stages of cloud-data maturity.
• Develop solution architectures, data migration and integration plans, and new features within a Databricks-based environment.
• Advise clients on Databricks architecture best practices and leverage the strengths of the platform to meet the specific requirements and use cases around architecture, standards and governance, and ensure flexibility and scalability of the solution.
• Advise and architect other elements of the Data Platform Modernization approach & architecture – including Databricks and/or AWS/Azure/GCP owned products
• Streaming/Batch data pipeline/engineering architectures 
• Build strong client, industry, and technical community relationships and represent Apex Systems as leaders in Industry and Professional events and communities. Develop and maintain strong internal and external customer relationships
• Demonstrate strong technical knowledge and implementation skills. Stay current on relevant technology trends and practices. Build trust and respect among internal and external stakeholders and demonstrate collaborative teamwork.
• Produce high quality deliverables, meet project deadlines, and take responsibility for engagement success. Demonstrate a passion for quality and process improvement
• Demonstrate professional level consulting skills and communication/presentation skills.
• Continually innovate, seek creative solutions, and find new ways of adding value. Listen and seek to understand the client and meet their needs, providing consultative guidance. Stay attuned to the future needs of the client and work with internal resources to identify opportunities. Proactively provide solutions and approach adversity with a solution-focused mindset
• Identify and evaluate new team members through professional networking and technical screening
• Experience in leading in creation of lakehouse reference architecture & runbook as part of an implementation
• Assist Apex solution, sales, and account teams during the scoping of new security opportunities as a technical subject matter expert

• 8+ years of experience in enterprise data and analytics architecture and/or development with 3+ years designing cloud-based solutions primarily leveraging Databricks.
• Adept at leveraging Azure and/or AWS-native services which complement Databricks in a Modern Data Platform setting (i.e. services related to data ingress, storage, engineering and analytics)
• Experience leading end-to-end migrations of data warehouse environments to Databricks.
• Experience developing and optimizing streaming data pipelines and enterprise infrastructure
• Experience implementing Databricks functionality specific to role-based access control (RBAC), data masking, and governance.
• Preferred prior experience working at Databricks or with Databricks professional services directly
• Preferred prior experience with Storage & Compute Optimization – partitions, clusters
• Preferred ML implementation/knowledge
• Preferred experience with streaming and batch data pipelines and engineering solution for ingestion
• Experience with working with teams of developers and other technical professionals in an Agile delivery framework
• Positive relationship builder able to navigate through complex situations to ensure the most robust and pragmatic solution
• Strong analytical skills and the aptitude to quickly identify gaps and risks
• Excellent written and spoken communication skills including the ability to help stakeholders navigate the trade-offs and alternatives to various solution architectures
• BA/BS required, preferably in Computer Information Systems, Computer Science, or related fields or applicable education and experience
• Advanced degree (MS) in a quantitative discipline preferred or applicable experience
• Expert-level understanding of enterprise data and analytics concepts like relational-data modelling, data integration, business intelligence and data-platform modernization (i.e. migrating from legacy technology environments to cloud-based platforms)
• Experience and proficiency with big data engineering languages (Java, Spark, Scala, Pyspark, Python, and SQL) 
• Experience with Medallion lakehouse data architecture implementation  
• Enterprise data modeling experience (Inman & Kimball) and leadership (standards and best practices and guidance)
• Experience with native services from 2 of the big 3 cloud providers (AWS, Azure, or GCP) 
• Experience with storage & compute optimization of partitions and clusters in Databricks
• Preferred Databricks Unity Catalog experience
• Experience with Streaming of data pipelines / engineering architecture nice to have
• Familiar with DataOps concepts and tooling for source control and CI/CD pipelines
• Hands on experience with Databricks and willingness to grow capabilities
• Databricks technical certification preferred but experience may be substituted

• Competitive salary
• Health, Dental and Vision Insurance
• Long and Short-Term Disability
• Life Insurance
• Vacation and Holiday Pay
• 401k Retirement Plan
• Training and Advancement opportunities
• Tuition Reimbursement
• Birthdays Off
• Philanthropic Opportunities
• Referral Program
• Partial Gym Membership Paid
• Team Building Events

EEO Employer

Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at [email protected] or 844-463-6178.