Data Engineer

Job Title: Data Engineer (DataOps)

Location: Dallas, TX (Onsite)

Employment Type: W2 Only

Job Summary

We are seeking a skilled Data Engineer (DataOps) to design, build, and support scalable data platforms and modern data pipelines. The ideal candidate will have strong expertise in Python, SQL, Spark, cloud technologies, ETL/ELT frameworks, CI/CD, and infrastructure automation. This role requires close collaboration with cross-functional teams to deliver reliable, secure, and high-performing data solutions while driving DataOps best practices.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Build, enhance, and support cloud-based data platforms, data lakes, and data warehouses.
• Develop and maintain CI/CD pipelines for data engineering workloads.
• Automate infrastructure provisioning, deployment, monitoring, and operational processes.
• Manage workflow orchestration, testing, observability, troubleshooting, and production support.
• Collaborate with data architects, business analysts, application development teams, and DevOps engineers.
• Implement DataOps best practices for data quality, governance, security, monitoring, and release management.
• Optimize data processing performance and ensure high availability and reliability of data platforms.
• Participate in incident management, root cause analysis, and continuous process improvement initiatives.

Required Skills & Qualifications

• Strong hands-on experience with Python, SQL, Spark, and ETL/ELT frameworks .
• Experience working with cloud platforms such as Microsoft Azure, AWS, or Google Cloud Platform (GCP) .
• Hands-on experience with one or more of the following:
• Databricks
• Snowflake
• Apache Kafka
• Apache Airflow
• Similar modern data engineering platforms
• Experience with CI/CD tools such as:
• Azure DevOps
• Jenkins
• GitHub Actions
• GitLab CI/CD
• Strong knowledge of:
• Docker
• Kubernetes
• Terraform
• Infrastructure as Code (IaC)
• Experience with data quality validation, monitoring, troubleshooting, and production support.
• Strong analytical, debugging, and problem-solving skills.
• Excellent communication and collaboration skills.

Preferred Qualifications

• Experience implementing DataOps best practices.
• Knowledge of data governance, security, and compliance.
• Experience building enterprise-scale cloud data platforms.
• Familiarity with workflow orchestration, observability, and monitoring frameworks.

Work Location

• Dallas, Texas – 100% Onsite

Employment Type

• W2 Only
• Candidates must be authorized to work on W2 and available to work onsite in Dallas, TX.