Data Engineer

Data Engineer (Databricks)

Location: Hybrid (Washington D.C

)Clearance: Active Secre

tEmployment Type: Full Tim

e
Company Descripti

onBig Impact Tech (BIT) is a Small Business providing IT and business management consulting to federal and commercial clients. We deliver mission-focused solutions in data, cloud, cybersecurity, and program managemen

t.
Position Overv

iewWe are seeking a skilled Data Engineer with strong Databricks expertise to support Coast Guard data modernization, analytics, and cloud transformation initiatives. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, data lakehouse solutions, and cloud-based data platforms that enable efficient data integration, storage, processing, and analyti

cs.
The candidate will work closely with data architects, analysts, developers, and business stakeholders to deliver reliable, secure, and high-performing data soluti

ons.
Key Responsibil

itiesDesign, develop, and maintain scalable data pipelines using Databricks and cloud-native technolo

gies.Build and optimize ETL/ELT processes for structured, semi-structured, and unstructured

data.Develop and manage data ingestion frameworks from various source systems, APIs, databases, and f

iles.Implement and maintain Delta Lake architecture and Lakehouse solut

ions.Develop PySpark, Spark SQL, and SQL-based transformations for large-scale data proces

sing.Support data warehousing, data lakes, and enterprise analytics initiat

ives.Monitor and optimize data pipeline performance, reliability, and scalabi

lity.Ensure data quality, governance, lineage, and security across data platf

orms.Collaborate with business stakeholders and technical teams to understand requirements and deliver data solut

ions.Implement CI/CD practices and automated deployment processes for data engineering solut

ions.Troubleshoot and resolve production issues related to data ingestion, transformation, and repor

ting.Create and maintain technical documentation, data dictionaries, and architecture diag

rams.
Required Qualific

ationsBachelor’s degree in Computer Science, Information Systems, Engineering, Data Science, or a related

field.5+ years of experience in Data Engine

ering.3+ years of hands-on experience with Datab

ricks.Strong experience with PySpark, Spark SQL, an

d SQL.Experience building large-scale data pipelines and ETL/ELT solu

tions.Experience with cloud platforms such as Azure, AWS, or Google

Cloud.Strong understanding of data modeling, data warehousing, and Lakehouse architec

tures.Experience working with relational and NoSQL data

bases.
Preferred Qualifi

cationsExperience supporting Coast Guard or other government-related pr

ograms.Experience with Azure Databricks, Azure Data Factory, Microsoft Fabric, Synapse Analytics, or Sno

wflake.Knowledge of Delta Lake, Unity Catalog, and Databricks Wor

kflows.Experience with real-time and streaming data sol

utions.Familiarity with DevOps practices, Git, CI/CD pipelines, and Infrastructure a

s Code.Experience with Power BI, Qlik, or Tableau reporting enviro

nments.Relevant Databricks or cloud certifications pre

ferred.
Technica

l SkillsDa

tabrick

sPySparkApac

he SparkS

par

k SQLSQLDe

lta LakeData Lakehouse Arch

itectureAzure Da

tabricksAzure Data

FactoryMicrosof

t FabricS

nowflakeData War

ehousingETL/ELT Dev

elopmentData

Mod

eling

GitCI/CDCloud Platforms (Azure, A

WS, GCP)