[Remote] Databricks Solutions Expert (Remote)

Note: The job is a remote job and is open to candidates in USA. GovCIO is hiring a Databricks Solutions Expert to support the Department of Veterans Affairs Data Modernization initiative. The role will architect, design, and implement Azure Databricks as a secure, governed, multi-tenant Lakehouse platform, while establishing engineering, governance, security, automation, and enablement standards for enterprise analytics teams.


Responsibilities

  • The Databricks Solutions Expert will define platform patterns, build reference implementations, set standards (cluster policies, Unity Catalog governance, CI/CD), and drive enablement so product, analytics, and data science teams can deliver reliable, compliant, and performant insights at scale
  • Blueprint the Azure Databricks landing zone: workspace topology (prod/non-prod), network architecture (VNet injection, Private Link, NAT), secure connectivity to ADLS Gen2, Azure SQL/MI, Event Hubs, and other data sources
  • Governance with Unity Catalog: multi-region metastores, catalog/schema/table design, data classification tiers, row/column-level security, data lineage, and cross-domain data sharing patterns (Delta Sharing)
  • Lakehouse foundations: Delta Lake storage design (bronze/silver/gold), medallion data flow standards, partitioning, Z‑ordering, OPTIMIZE/VACUUM policies, and performance best practices (Photon, AQE)
  • Scalability for “thousands of teams”: multi-workspace strategy, tenancy model (shared vs. dedicated), workspace baselines, cluster policy tiers, and guardrails to prevent noisy-neighbor and cost runaways
  • Reliability: HA/DR strategy, regional deployments, backup/restore, versioning, and repeatable environment provisioning via Terraform
  • Identity & access: Entra ID (Azure AD) SSO, SCIM user/group provisioning, service principals/managed identities, attribute-based/role-based access controls mapped to Unity Catalog
  • Secrets & credentials: Key Vault–backed secret scopes, credential passthrough patterns, token hygiene (PAT governance)
  • Data protection: encryption at rest/in transit, private endpoints, data exfil and egress controls, policy-as-code, and audit logging to Log Analytics or secure storage
  • Compliance: enforce enterprise policies (PII/PHI handling), data retention, legal hold, and regulatory reporting with auditable lineage
  • Pipelines: build DLT (Delta Live Tables) pipelines and jobs for batch and streaming (Structured Streaming) with CDC (e.g., via Auto Loader) from enterprise sources
  • Performance engineering: optimize notebooks/SQL/ETL (Photon, caching, skew mitigation), tune cluster sizing, and set standards for reliable, fast jobs
  • MLOps: integrate MLflow for experiment tracking, model registry, feature store (Unity Catalog), and serving patterns where appropriate
  • Observability: end-to-end monitoring (jobs, clusters, UC audits), dashboarding, alerting, and SLOs; integrate with Azure Monitor/Log Analytics
  • Enablement: build reusable reference accelerators (templates, example notebooks, data products), run playbooks, and conduct office hours to uplevel 1000s of teams
  • Infrastructure-as-Code: provision workspaces, catalogs, cluster policies, and permissions via Terraform (Databricks provider), with pipelines in Azure DevOps/GitHub
  • CI/CD: notebook/package deployment, testing harnesses (dbx/pytest), environment promotion, and artifact versioning
  • FinOps: cost modeling, budgets/alerts, instance pools, auto-termination, serverless SQL, tagging/chargeback, and usage analytics for executive reporting
  • Partner with Security, Networking, Compliance, and FinOps to codify enterprise standards
  • Establish a Lakehouse Platform Council to ratify patterns and review exceptions
  • Create adoption metrics, business case narratives, TCO models, and executive updates

Skills

  • Bachelor's degree in Information Technology or a related field. (or commensurate experience)
  • 12+ years of experience in data engineering/analytics; 5+ years building on cloud data platforms (Azure preferred)
  • 3+ years hands-on Azure Databricks (platform + pipelines) and Delta Lake
  • Proven experience setting up Unity Catalog with granular governance (RLS/CLS)
  • Deep knowledge of Azure networking (VNets, Private Link, NSGs), identity (Entra ID), Key Vault, ADLS Gen2, Event Hubs, Azure SQL/MI, and Data Factory
  • Strong Spark expertise (PySpark/SQL), Structured Streaming, performance tuning, partitioning and storage optimization
  • Practical Terraform experience for Databricks/Azure resources; CI/CD with Azure DevOps or GitHub Actions
  • Security-first mindset; track record implementing audit logging, policy-as-code, and compliance controls
  • Excellent communication skills; ability to standardize, teach, and influence at enterprise scale
  • Ability to obtain and maintain a suitability/Public Trust
  • Experience operating platforms for >500 concurrent users and 1000s of analytics teams
  • Knowledge of Photon, DLT, Workflows, Lakehouse ML (MLflow, feature store), Delta Sharing
  • Exposure to FinOps and chargeback models for data platforms
  • Experience with Synapse/Fabric interoperability, and data virtualization patterns
  • Background in data modeling (medallion, dimensional, domain‑driven design) and data quality (expectations, SLAs)
  • + Databricks: Databricks Certified Data Engineer Professional, Lakehouse Fundamentals, Machine Learning Associate/Professional
  • + Microsoft: Azure Solutions Architect Expert (AZ‑305), Azure Data Engineer (DP‑203), Azure Security Engineer (AZ‑500)
  • + HashiCorp: Terraform Associate
  • Scala (optional)

Benefits

  • This position is fully remote within the United States.

Company Overview

  • GovCIO is a business consulting firm that focuses on cyber security, digital, data, management and mission services, and IT services. It was founded in 2010, and is headquartered in Fairfax, Virginia, USA, with a workforce of 1001-5000 employees. Its website is

  • Company H1B Sponsorship

  • GovCIO has a track record of offering H1B sponsorships, with 1 in 2025, 3 in 2024, 2 in 2023, 7 in 2022. Please note that this does not guarantee sponsorship for this specific role.

  • Back to blog

    Other Jobs To Apply

    Remote Airline Job, Work From Home Jobs Airline @ Get Dream Job

    Administrative Assistant, Social Media Management

    Remote Customer Experience Representative – Flexible Schedule, $19+ Starting Pay, No Degree Required, Work From Anywhere

    Watch Netflix (Tagger): $12-$46

    Entry-Level Remote Data Entry Specialist – Teens, No Experience Needed, Flexible Hours, Competitive Pay, Join arenaflex

    Entry Level Remote Chat Operator (No Experience)

    Jr. Data Entry Clerk / Full-Time (Remote)

    Call Center Specialist [Work From Home - Night Shift - Full Time]

    Seeking Private American Curriculum Mathematics Tutor in Dubai

    Call Center Specialist [Work From Home - Night Shift - Full Time]

    Call Center Specialist [Work From Home - Night Shift - Full Time]

    Call Center Agent (PT or FT - 100% Work From Home)

    Excel Tutor – Part Time Remote Jobs

    **Experienced Customer Support Representative – No Phone, Fully Flexible reputed company**

    Long-haul Cabin Host-Atlanta,GA | Hiring

    Software Engineer II, Backend (Batch Developer Experience)

    Hiring for HEDIS - Data Engineer :: Remote

    Gas Automation Engineer at Liberty Personnel Services, Inc. Goleta, CA

    Call Center Agent (PT or FT - 100% Work From Home)

    [Remote] Program Leader, Customer Advocacy Solutions Courier Experience

    FULL TIME Remote Chat Support ? Beginner Level / No Phone Call /

    Remote Freelance Translator: Malayalee or Egyptian

    Amazon Content Moderator - Remote Position Available

    Evening Part Time Remote Customer Support Speci…

    Entry-Level Virtual Assistant Opportunity at Target: Administrative Excellence in a Dynamic Remote Setting

    Business/Data Analyst - Entry Level

    Experienced Part-Time Virtual Intern – College Student Opportunity in Remote Work Environment with The Elite Job

    Amazon Fulfillment Center Jobs - Day And Night Shifts Open

    Experienced Mothers Wanted to Help a Growing Family

    Bilingual Mandarin Social Media Content Moderator

    Virtual Data & Transcription Support Specialist (Part-Time | Full-Time)

    [Remote-Position] Amex Virtual Assistant (Remote) ? The EliteJob

    Splunk Solutions Engineer - South Africa

    Watch And Tag Netflix Job @ Get Dream Job

    Watch Netflix (Tagger): $12-$46

    Urgently Hiring: [Part Time] Virtual Assistant Jobs No Experience

    Watch Netflix (Tagger): $12-$46

    Disney Work From Home Jobs Santa Fe, Disney Careers Jobs Apply In USA ( Operations Producer )

    Amazon Remote Part-time jobs - Immediate Hiring Now

    Watch Netflix (Tagger): $12-$46

    Pediatrician – Urgent Care American Hospital Dubai

    Remote Freight Operations Coordinator | Night Shift (EST)

    Work From Home Jobs At Walmart $24/Hour

    Global Brand Manager — Skincare Growth & Launch

    Executive Secretary & Administrative Coordinator - Telework Eligible

    Amazon Fulfillment Center - Order Picker

    Flight Attendant at Southwest Airlines(Part-Time,Atlanta)

    Remote Out of Office Position / Data Entry (Hiring Immediately)

    Content Ingestion Assistant – Night Shift - Remote

    Walgreens Jobs In USA (Remote Careers)