[Remote] Databricks Engineer

Note: The job is a remote job and is open to candidates in USA. Net2Source is seeking a Databricks Engineer to assist in migrating an underperforming customer solution to Databricks. The role involves analyzing current solutions, building data pipelines, and enhancing AI-driven components to ensure performance and reliability.

Responsibilities

• Migrate existing data pipelines and workflows to Databricks
• Analyze the customer's current solution and implement improvements
• Build and optimize Python- and SQL-based pipelines
• Develop and enhance AI-driven parsing and extraction components
• Ensure performance, data quality, and reliability
• Collaborate with technical and business teams to deliver a stable solution

Skills

• Hands-on experience with Databricks (clusters, notebooks, Delta Lake)
• Strong Python (required) and SQL skills
• Experience with AI parsing/extraction and text-processing workflows
• Background in data migration and troubleshooting
• Experience with Azure Databricks, MLflow, or Lakehouse architecture
• Knowledge of document intelligence tools and DevOps workflows

Company Overview

Company H1B Sponsorship